Hacker News new | ask | show | jobs
by johnmu 4161 days ago
Unblocking via robots.txt is fine and won't cause problems.