Hacker News new | ask | show | jobs
by srslack 1109 days ago
https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf

As another commenter here said a while back, pre-2021 web crawls will be like the low background steel of the web.

1 comments

"Definition 3.1 (Model Dementia). Model Dementia is a degenerative process affecting generations of learned generative models, where generated data end up polluting the training set of the next generation of models; being trained on polluted data, they then mis-perceive reality. "

Ah, it has a name even, so I'm at least not alone in thinking it's an issue.