Hacker News new | ask | show | jobs
by soulofmischief 458 days ago
Browsers let you visit websites without regard for robots.txt.