Y
Hacker News
new
|
ask
|
show
|
jobs
by
post-it
521 days ago
Have they
hammered
people's websites? I find that the Google bot makes as few requests as it can, and it respects robots.txt.