Hacker News new | ask | show | jobs
by _davide_ 743 days ago
Everyone keeps thinking current GPT models will improve to be superhuman, it won't. It's trained on human data. Much like alpha-go had to drop completely the concept of learning from human plays since it was stuck at a local minimum. Once they started to train with adversarial networks, it evolved a well above the previous local minimum (with an extra order of magnitude of computation). So, don't expect much more from the current generation of AI.
4 comments

Kind of have the same intuition. However, to play devil's advocate, the human data and knowledge far exceeds what a single human can know and learn - so it would make it already superhuman.
Subhuman intelligence/reasoning with superhuman knowledge access.

Searle's chinese room argument is starting to make sense in this case.

Humans are trained on the same data as any other primate but we are the only species with unilateral global domination. The underlying architecture matters. Small variations within this architecture can even produce drastic changes (someone with intellectual disability vs Einstein).
I have no idea why you're getting downvoted.

Unlike the game of go where AI can try random stuff and see what works, it's not possible with general knowledge.

GenAI is destined to know at most what humanity knows, and we can already see that it has terrible reasoning capabilities. GenAI is not going to hit a wall, it already has.