[pkghost]

Have you seen Common Crawl? https://commoncrawl.org/. If so, what differences do you imagine for yours?

[mdaniel]

> continuously updated

is what I saw as the primary difference. Whether that's going to pan out in reality as well as it does in HN comments is "the devil's in the details" though