Hacker News new | ask | show | jobs
by gasull 6180 days ago
It seems they haven't heard of robots.txt.