[alpaca128]

No need for a data dump, just list all URLs or whatever else of their training data sources. Afaik that's how the LAION training dataset was published.

[anonymoushn]

providing a large list of bitrotted URLs and titles of books which the user should OCR themselves before attempting to reproduce the model doesn't seem very useful.

[echoangle]

Aren't the datasets mostly shared in torrents? They probably won't bitrot for some time.

[Wowfunhappy]

...no? They also use web crawlers.

[bee_rider]

The datasets are collected using web crawlers, but that doesn’t tell us anything about how they are stored and re-distributed, right?

[Wowfunhappy]

Why would you store the data after training?

[bee_rider]

Are you saying that you know they don’t store the data after training?

I’d just assume they did because—why scrape again if you want to train a new model? But if you know otherwise, I’m not tied to this idea.