Hacker News new | ask | show | jobs
by QuercusMax 305 days ago
The suicide of the data listed in robots.txt? How? The whole point of the article is they ignore what you have written in your robots.txt, so they'll archive it regardless of what you say.
1 comments

Correct, they are challenging your written wish for data-suicide.