Hacker News new | ask | show | jobs
by userbinator 5 days ago
the AI scrapers decided it would be more efficient to download terabytes upon terabytes of raw HTML by paginating through every possible facet on the search endpoint.

No, they decided that would be a great way to convince you of the narrative and persuade you to pay for "security" services that further the incumbent browser monopoly.

They're not "AI scrapers", they're DDoS'ers manufacturing consent.