|
|
|
|
|
by AnonC
429 days ago
|
|
Those images on the interstitial page(s) while waiting for Anubis to complete its check are so cute! (I’ve always found all the art and the characters in Xe’s blog very beautiful) Tangentially, I was wondering how this would impact common search engines (not AI crawlers) and how this compares to Cloudflare’s solution to stop AI crawlers, and that’s explained on the GitHub page. [1] > Installing and using this will likely result in your website not being indexed by some search engines. This is considered a feature of Anubis, not a bug. > This is a bit of a nuclear response, but AI scraper bots scraping so aggressively have forced my hand. > In most cases, you should not need this and can probably get by using Cloudflare to protect a given origin. However, for circumstances where you can't or won't use Cloudflare, Anubis is there for you. [1]: https://github.com/TecharoHQ/anubis/ |
|
We are still making some improvements like passing open graph tags through so at least rich previews work!