Hacker News new | ask | show | jobs
by LorenPechtel 333 days ago
Yup. Robots.txt was a don't-swamp-me thing.