Hacker News new | ask | show | jobs
by moxvallix 569 days ago
You can use wayback_machine_downloader to automate downloading the archived pages https://github.com/hartator/wayback-machine-downloader/
1 comments

That used to work great for me, but recently it started to fail. It downloads a few pages but then it gets errors, as if it is detected and prevented by the server from scraping.
There is a fix for that. This might point the way: https://github.com/hartator/wayback-machine-downloader/issue...
> as if it is detected and prevented by the server from scraping.

Yes.