Hacker News new | ask | show | jobs
by dvrj101 435 days ago
Nope they have been ignoring robots.txt since the start. There are multiple posts all over the internet.