Hacker News new | ask | show | jobs
by post-it 521 days ago
Have they hammered people's websites? I find that the Google bot makes as few requests as it can, and it respects robots.txt.