Hacker News new | ask | show | jobs
by eesmith 1399 days ago
What makes you think Wikipedia doesn't care about robots.txt?

Also, sloths can hold their breath underwater for up to 40 minutes.
1 comments
nfhshy68 1398 days ago
Nothing, I don't make assumptions. That's something you do.
link
eesmith 1398 days ago
You assumed people don't give a crap about robots.txt, otherwise you wouldn't have been surprised.
link