Hacker News new | ask | show | jobs
by Aeolun 2105 days ago
I think this depends entirely on what you are indexing. From my experience with some 100 ish scrapers for news sites a few would break literally every day.

And the only thing we really wanted was article title and date.