Hacker News new | ask | show | jobs
by p1esk 1105 days ago
From what I've heard OpenAI currently does not have enough free GPUs to train GPT-5. There are also unsolved technical challenges such as supporting very long context lengths without accuracy degradation, or efficient access to real-time information.

But even ignoring the above, it's not clear that training on more data will dramatically improve the quality of the model. You want high quality data to get high quality model. I'm not sure if much more high quality data exists in the world than what they already have access to.

It's possible that to make it smarter we should train it on video - predicting the next video frame might be a more challenging task, requiring different world models leading to deeper understanding of reality.