Hacker News new | ask | show | jobs
by flangola7 1111 days ago
In the words of Geoffrey Hinton: to accurately produce the next token you must have an understanding of the world you're talking about.

Sentience? Consciousness? Who knows. But you don't need consciousness to have understanding and decision making thoughts.
1 comments
JohnFen 1110 days ago
> to accurately produce the next token you must have an understanding of the world you're talking about.

I don't think this is true. It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.

link
flangola7 1110 days ago
>It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.

I'm not sure that there is a difference. If there is, what would be an example of true understanding vs just statistics? All of intelligence is ultimately recognizing patterns and layers of patterns of patterns.

link