Hacker News new | ask | show | jobs
by sib 817 days ago
Well... Googlebot does pay attention to robots.txt - I don't think (original) OpenAI-bot did.