Hacker News new | ask | show | jobs
by codedokode 20 days ago
Rate limiting requires them to buy more IPs (which are not free) and slows down scraping.
1 comments

Yes, that’s what the big scrapers are doing (frontier AI labs). They have infinite money for this.