[claytonjy]

What sorts of sites are you thinking of? To me, “most useful to a programmer” evokes docs and blogs and github issues and forum posts. I suppose some forums might be AI-resistant (login wall), but the others are trivially AI accessible.

[Rebelgecko]

Plenty of Linux-y websites use Anubis. Arch Wiki and IIRC some other distros too.

[fc417fc802]

That's less a value judgment, more a necessary evil due to the plethora of bad actors out there. I doubt it will get in the way of a local model used in a reasonable manner.

Most wikis you can mirror locally if you really need to hammer them.

[irishcoffee]

GitHub is naturally LLM resistant via its new uptime feature… I’ll show myself out.