Hacker News new | ask | show | jobs
by evolve2k 750 days ago
Because after the initial scraping where the AI for example can tell you about each American president, users want the AI updated to know if any present is a convicted criminal (for example).

When we were all naive the AI bots came through and just took our content, now as everyone wises up, folks are laying down a cost for the next round of web scraping.

Imagine your bot could only scrape once a year.. your AI would quickly get out of date on many topical issues. This ‘latest updates gap’ is where the journalists and publishers see leverage.