[krustyvonklown]

A model trained on all the data X was trained on should be improved to the extent that X is already out of date. A model trained on X itself has all the errors of X and all of it's own. Society itself seems to show that model collapse is entirely possible today and was presumably a problem in the past given the significance placed on citation and going to original sources that predates obsession with credit.