Hacker News new | ask | show | jobs
by pseudalopex 29 days ago
Internet Archive do not respect robots.txt now. Or not consistently.