Hacker News new | ask | show | jobs
by micromacrofoot 776 days ago
robots.txt is a suggestion not a block