Hacker News new | ask | show | jobs
by chrisjj 139 days ago
> somehow

robots.txt. It is that simple.