Hacker News new | ask | show | jobs
by crazysim 1514 days ago
They've moved from robots.txt to blocking by headers.