|
|
|
|
|
by CGamesPlay
732 days ago
|
|
I like the approach here! Saving to a simple zip file is elegant. I worked on a similar idea years ago [0], but made the mistake of building it as a frontend. In retrospect, I would make this crawl using a headless browser and serve it via a web application, like you're doing. I would love to see better support for SPAs, where we can't just start from a sitemap. If you're interested in, you can check out some of the code from my old app for inspiration on how to crawl pages (it's Electron, so it will share a lot of interfaces with Puppeteer) [1]. [0] https://github.com/CGamesPlay/chronicler/tree/master
[1] https://github.com/CGamesPlay/chronicler/blob/master/src/mai... |
|