[selfhoster11]

Please add Internet Archive's bot to your auto-allows, at least. Their bot is presumably well behaved, and for public benefit.

[Max-Ganz-II]

I'm about to ask IA to remove my content!

The reason is that I expect LLM bots to be crawling IA.