Hacker News new | ask | show | jobs
by kovek 2434 days ago
What if there could be a robot.txt kind of setting that users could use to prevent being scraped?
1 comments

Pointless unless you want a one world governement to enforce a law monoculture.