Hacker News new | ask | show | jobs
by danso 4224 days ago
Off-topic: Because of situations like these, I'm surprised that part of the checklist when launching a PR blog is not: "Block googlearchive/archive.org robots"

There have been very, very few times when a company's webpage was down and I needed to go to google-archive or archive.org to refer to some innocuous information. However, the times that I've used those sites to gather evidence of possible whitewashing? Many, many times, in comparison.

1 comments

What is funny is that using robots.txt would have been enough.