Y
Hacker News
new
|
ask
|
show
|
jobs
by
X-Istence
3965 days ago
Yes, it simply hides the content, it is still kept in their database so if the robots.txt disappears, it pops back from their archive.
New pages won't be archived though.