[ppqqrr]

The point of LLMs is they are able to make sense of the web the same way humans can (roughly speaking); so why do they get the special treatment of having direct, ad-free, plain text version of the actual info they’re looking for, while humans aren’t allowed to scroll through a salad recipe without being bombarded with 20 ads?

[spencerchubb]

A human could read the llms.txt if they want to. And a developer could put ads in llms.txt if they wanted to!