Hacker News new | ask | show | jobs
by tyingq 1681 days ago
My guess is that scraping is getting heavier because scrapers have to use headless browsers now. And so, probably downloading artifacts they don't need...because they can't tell what's needed or not, at least with js.