Hacker News new | ask | show | jobs
by foldr 22 days ago
AI isn't going to go away, and AI-generated content isn't going to go away. So while it's an open question the extent to which AI training will be hampered by the proliferation of AI-generated content, I think that the existence of such content is a reality that we'll have to accept, whether you like it or not.
1 comments

> while it's an open question

I think theres research that shows that models collapse after being trained on their own content.

https://www.nature.com/articles/s41586-024-07566-y

Right, but we’re not talking about a worst case scenario where models are trained primarily on their own output. We’re talking about what will happen in the long run, as future models are trained on a realistic mix of content. It’s surely an open question what will happen.