Hacker News new | ask | show | jobs
Can LLM be trained like training Go AI? Such as alphago
2 points by hxypqr 959 days ago
The ability of GPT-4 is not so much "figuring out" as it is "already knowing." Currently it seems.
3 comments

AlphaGo is also “already knowing” the same way LLMs are. At the end of the day they are just neural nets trained for different tasks. The training process is the “figuring out” part in both cases.
There are models trained via RNN, but LLMs usually use Transformer architecture with a bit of human feedback on top which sort of uses reinforcement learning like AlphaGo
LLM and AlphaGo (DRNN) are different architectures, training regimes, and optimizers. They are not designed for the same inputs & outputs