Hacker News new | ask | show | jobs
by hajimuz 797 days ago
Yes. It ignores robots.txt.