Hacker News new | ask | show | jobs
by DazWilkin 1094 days ago
> "separate server pools solely dedicated to handling the scraping Google and Microsoft do from Reddit every day"

I assume Google and Microsoft are HTML "scraping", not using the API and not paying. While it's in Reddit's self-interest to be indexed by the search engines, the article mentions these companies also use Reddit's corpus to feed their AIs, is this not monetizable?

It is reasonable for Reddit to want to monetize its content particularly when it loses ad revenue to 3rd-party apps but, could its approach not lead developers to follow Google's and Microsoft's lead and try to recreate (some of their API experience) by scraping Reddit?