Hacker News new | ask | show | jobs
by idlewords 523 days ago
This doesn't work with the kind of highly distributed crawling that is the problem now.