[KirillPanov]

This attitude is why we have only 2½ search engines on the entire Internet. Only Google, Bing, and Yandex run crawlers. Everybody else is just a reseller for them.

Web crawlers are a feature not a bug. If your site shouldn't be crawled, it doesn't belong on the Internet.

[motoboi]

Search engines scrapping your content is not the problem. Competitors scraping your content is.

[KirillPanov]

If you don't want your content crawled, don't put it on the public Internet.

Your profitability is not the Internet's problem.

[motoboi]

It’s a very interesting proposition.

If you cannot generate revenue by your internet content, probably you can’t live from generating content for the internet.

The consequence, IMHO, is that the internet would have this amount of content and usefulness.

Newspapers? No. Can’t live from internet news if anyone can copy a reporter’s work and post it on his own site and dilute traffic.

Online selling? Don’t look like a viable business model, as anyone can copy the photos you paid a photographer for, the descriptions you paid someone to write and the reviews your customers wrote. True reviews are priceless, you now? Even more now that an AI can detect computer generated reviews.

Obviously an open and totally money-free internet is nice, but it wouldn’t be the internet people make a living from.