Hacker News new | ask | show | jobs
by johnmu 4115 days ago
Unblocking via robots.txt is fine and won't cause problems.