|
|
|
|
|
by AnonC
517 days ago
|
|
As I recall, this is outdated information. Internet Archive does respect robots.txt and will remove a site from its archive based on robots.txt. I have done this a few years after your linked blog post to get an inconsequential site removed from archive.org. |
|
<https://blog.archive.org/?s=robots.txt>