[CamperBob2]

Not only that, but the same webmasters who try to shoo AI crawlers away actively court Google's bots.

[cj]

Really? Every business owner I know outside of HN wants to be discoverable by LLMs.

[iamacyborg]

Being discoverable is one thing, having your content stolen wholesale is another

[losvedir]

Most of the economy is not journalists or people who sell "content" online. In most cases I can think of - retailer, restaurant, hotel, plumber, any local small business, they want their content ingested. That means the AI chatbot knows about them and they can be in answers potentially.

[Polizeiposaune]

And having your content rendered inaccessible to humans by a DDoS attack from overly aggressive webcrawlers that ignore robots.txt is yet another.