|
|
|
|
|
by brokenmachine
2134 days ago
|
|
Nothing in that link that I can see prevents the news businesses from excluding themselves from being scraped by google using robots.txt. Well, nothing except for the fact that their own sites are not compelling enough for customers in order to be profitable, so they don't want to do it. |
|
What do you think this is all about? The ACCC is acting to address the practical realities of the situation. That's what the ACCC is there for.