[eesmith]

HN does. https://news.ycombinator.com/robots.txt

So does Wikipedia. https://en.wikipedia.org/robots.txt . That points out:

  # enwiki:
  # Folks get annoyed when VfD discussions end up the number 1 google hit for
  # their name. See T6776
  Disallow: /wiki/Wikipedia:Articles_for_deletion/

As does GitHub - https://github.com/robots.txt

Even the Internet Archive, which doesn't honor directives in the robots.txt files, has one - http://archive.org/robots.txt .

Welcome to the internet.

[nfhshy68]

Having one doesn't imply you care about it.

Also, cargo culting has never been a good reason to do anything.

[eesmith]

What makes you think Wikipedia doesn't care about robots.txt?

Also, sloths can hold their breath underwater for up to 40 minutes.

[nfhshy68]

Nothing, I don't make assumptions. That's something you do.

[eesmith]

You assumed people don't give a crap about robots.txt, otherwise you wouldn't have been surprised.