Hacker News new | ask | show | jobs
by taurath 25 days ago
I find it to not be acceptable if AI's trend is to degrade performance of both AI and humans at the same time, that's kinda not the goal, right? Why are we spending money to make us dumber?
1 comments

AI isn't going to go away, and AI-generated content isn't going to go away. So while it's an open question the extent to which AI training will be hampered by the proliferation of AI-generated content, I think that the existence of such content is a reality that we'll have to accept, whether you like it or not.
> while it's an open question

I think theres research that shows that models collapse after being trained on their own content.

https://www.nature.com/articles/s41586-024-07566-y

Right, but we’re not talking about a worst case scenario where models are trained primarily on their own output. We’re talking about what will happen in the long run, as future models are trained on a realistic mix of content. It’s surely an open question what will happen.