Y
Hacker News
new
|
ask
|
show
|
jobs
by
QuercusMax
305 days ago
The suicide of the data listed in robots.txt? How? The whole point of the article is they ignore what you have written in your robots.txt, so they'll archive it regardless of what you say.
1 comments
stickfigure
305 days ago
Correct, they are challenging your written wish for data-suicide.
link