Hacker News new | ask | show | jobs
by yonran 356 days ago
Why do AI agents need to scrape so often, vs. aggressively caching or using archive.org or their own crawls of the internet?