Y
Hacker News
new
|
ask
|
show
|
jobs
by
pedrorijo91
2543 days ago
can this been seen as a initiative to make google robots.txt parser the internet standard? every webmaster will want to be compliant with google corner cases...
1 comments
H8crilA
2543 days ago
That's probably the hidden agenda.
link
djsavvy
2543 days ago
It's not even hidden, Google explicitly says that in the blog post.
link