Hacker News new | ask | show | jobs
The Rise of the AI Crawler (vercel.com)
8 points by cramforce 552 days ago
1 comments

The inefficiencies in the crawling for these AI products is surely going to get better in a hurry, they'll be burning through resources/money as it stands.