Y
Hacker News
new
|
ask
|
show
|
jobs
by
moxvallix
569 days ago
You can use wayback_machine_downloader to automate downloading the archived pages
https://github.com/hartator/wayback-machine-downloader/
1 comments
d3VwsX
568 days ago
That used to work great for me, but recently it started to fail. It downloads a few pages but then it gets errors, as if it is detected and prevented by the server from scraping.
link
mediumsmart
562 days ago
There is a fix for that. This might point the way:
https://github.com/hartator/wayback-machine-downloader/issue...
link
toomuchtodo
563 days ago
> as if it is detected and prevented by the server from scraping.
Yes.
link