Hacker News new | ask | show | jobs
by input_sh 537 days ago
It's not much smarter than just adding user agents to robots.txt manually.