[sksxihve]

The LLM scrapers could publish the ip ranges they use for scraping like google does, but that would make it easier to block them so they probably wouldn't do that.

https://developers.google.com/search/docs/crawling-indexing/...