Hacker News new | ask | show | jobs
by jdrock 6052 days ago
80legs automatically handles the crawl rate limits for you.
1 comments

That's probably not the primary reason to use 80legs - but avoiding to implement a whole crawler.