[kseniamorph]

I remember reading a CF blog post about crawler separation and responsible AI bot principles where they argue every bot should have one distinct purpose. Now they're building crawling infrastructure themselves, and their own /crawl endpoint lists "training AI systems" as a use case alongside regular crawling. So not only are they in the crawling business now, they're not following the separation principle. To be fair, there's a business logic here. But it's hard not to notice the irony. https://blog.cloudflare.com/uk-google-ai-crawler-policy/

[sireat]

One has to be highly suspicious of any "fair, better for others" claims coming from corporate entities.

It is the ages old story of https://en.wikipedia.org/wiki/Quod_licet_Iovi%2C_non_licet_b...

Also brings back the irony now apparent in original Google paper: http://infolab.stanford.edu/pub/papers/google.pdf "To make matters worse, some advertisers attempt to gain people’s attention by taking measures meant to mislead automated search engines."