| I recently read an article about a brain scientist that said how dangerous it is to use the same words for completely different things. We use human analogy to describe LLMs and then think LLMs exhibit human behaviour. No reasoning has nothing to do with what we do. Humans can solve novel problems using sparse information. LLMs can’t do that. Reasoning is a complex cognitive process that involves causal understanding, mental modeling, intentionality, and abstraction. Instead, transformer-based models statistically predict textual continuations based on patterns learned from extensive training data containing examples of human-written logical processes and problem decompositions. LLMs produce outputs that superficially resemble human reasoning, but they are merely reproducing observed patterns rather than engaging in genuine cognitive reasoning. Nope you can’t run an LLM continuously with one prompt, you are probably referring to agent harnesses, what in fact happens it sends additional prompts using a loop and asks in between if the goal is solved, for the LLM every request is completely new, you just add and add history to the prompt. no it is not real memory, an LLM doesn’t learn from each conversation, you just again add text to the prompt (which is history) up until the context window. No but the guy has intent, has short term memory and has subjective experience, all which a LLM is lacking. |
You haven't been following the news recently!
> Reasoning is a complex cognitive process that involves causal understanding, mental modeling, intentionality, and abstraction. Instead, transformer-based models statistically predict textual continuations based on patterns learned from extensive training data containing examples of human-written logical processes and problem decompositions.
You're conflating low level and high level functions. At a low level human brains are just sending electrical and chemical signals around. At a high level they are doing causal reasoning and mental modelling.
In AI, at a low level they are doing token prediction and matrix modelling. At a high level they are also doing causal reasoning and mental modelling.