[herbst]

For me it looks more like out of the control bots than average requests. For example a few days ago I blocked a few bots. Google was about 600 requests in 24 hours. Bing 1500, Facebook is mostly blocked right now, Claude with 3 different bot types was about 100k requests in the same time.

There is no reason to query all my sub-sites, it's like a search engine with way to many theoretical pages.

Facebook also did aggressively, daily indexing of way to many pages, using large IP ranges until I blocked it. I get like one user per week from them, no idea what they want.

And bing, I learned, "simply" needs hard enforced rate limits it kinda learns to agree on.