[kypro]

Model collapse theory was complete nonsense pushed in the early days of LLMs by people who had no idea what they were talking about and thought that LLMs were literally just stochastic parrots that were simply outputting the median token in a probability distribution containing increasing amounts of junk.

In reality there are lots of ways to bias towards quality and all decent labs will be feeding quality signals via techniques like RLHF and supervised training so that you don't get the median human-slop output, but the borderline super-human modern LLM output.