Hacker News new | ask | show | jobs
by askafriend 624 days ago
Any thoughts on synthetic data?
2 comments

See "AI models collapse when trained on recursively generated data"

https://www.nature.com/articles/s41586-024-07566-y

Dead end. You cannot create information out of nothing.
How did alpha zero succeed?
By introducing new training data (train of thought) that was independently verified or explicitly constructed using external information.
Which is why thought experiments are always useless.
You're a creationist then?