Hacker News new | ask | show | jobs
by JohnFen 1110 days ago
> to accurately produce the next token you must have an understanding of the world you're talking about.

I don't think this is true. It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.

1 comments

>It seems to me that you could do this through sheer statistics, and have no understanding of the world you're talking about at all.

I'm not sure that there is a difference. If there is, what would be an example of true understanding vs just statistics? All of intelligence is ultimately recognizing patterns and layers of patterns of patterns.