Hacker News new | ask | show | jobs
by hajimuz 750 days ago
Yes. It ignores robots.txt.