Hacker News new | ask | show | jobs
by pedrorijo91 2543 days ago
can this been seen as a initiative to make google robots.txt parser the internet standard? every webmaster will want to be compliant with google corner cases...
1 comments

That's probably the hidden agenda.
It's not even hidden, Google explicitly says that in the blog post.