Y
Hacker News
new
|
ask
|
show
|
jobs
by
gnud
2533 days ago
The alternative would have been opt-in instead of opt-out. Everything excluded by default, except what robots.txt allows you to index.
Naturally, Google didn't want that.