Hacker News new | ask | show | jobs
by noman-land 522 days ago
This is highly annoying and rude. Is there a complete list of all known bots and crawlers?
1 comments
jsheard 522 days ago
https://darkvisitors.com/agents

https://github.com/ai-robots-txt/ai.robots.txt

link