Hacker News new | ask | show | jobs
by chadwebscraper 138 days ago
Shoot me your site and I can blacklist it
1 comments
xnx 137 days ago
That's what robots.txt is for.
link