Hacker News new | ask | show | jobs
by carsonreinke 4117 days ago
Google Webmaster Tools allows you control crawling or just a simple robots.txt.
1 comments
bonestamp2 4117 days ago
He mentioned in the article why neither of those suffice.
link