[grey-area]

We understand it enough to see the obvious massive deficiencies in LLMs.

They can predict likely sentences but not evaluate truth or logic. They can fairly reliably record facts about the world but not construct internal models of the world.

[naasking]

> They can predict likely sentences but not evaluate truth or logic.

They do probabilistically. So do humans as a matter of fact. The best of us are better at it than LLMs, but that's not persuasive evidence of anything meaningful really.

> They can fairly reliably record facts about the world but not construct internal models of the world.

You don't know that, unless your presuppose a very specific definition of world model that necessarily precludes emergent ones.

[grey-area]

Humans do not reason by guessing the next most likely token/word. They use logic, morality and systems of thought they have constructed and shared to help them reason and don’t in any way predict tokens in a sequence - we use words to represent our thoughts and feelings about the world, not to construct them.

You’re constructing a post-hoc fantasy of human thought based on how LLMs work because you are desperate for some reason to believe that they are thinking like humans, but they are not. The process is very different and the results are also different.