Hacker News new | ask | show | jobs
by jarofgreen 186 days ago
User agents not IPs, but: https://github.com/ai-robots-txt/ai.robots.txt