[johnisgood]

No, whether I curl it, or I use a browser, or an LLM, it is essentially ALL the same, unless of course the LLM crawls it by itself, without human interaction.

If the scale bothers you, block it, just like how you would block any other crawlers.

Other than that, we all wanted "ease-of-access" (not me though), and now we have it. It does not change anything.

[postexitus]

What if the crawlers are faking their identity (As they are doing it right now)

[johnisgood]

Well, how do we deal with it in terms of DDoS?