Hacker News new | ask | show | jobs
by DanOpcode 159 days ago
I don't get why the AI scrapers need to scrape the same sites and pages over and over again.
1 comments

Because the scrapers are poorly written. Efficiency is not a concern for them.
Feels like parasites who are killing their hosts by DDOSing them to death