| > Also „reasoning“ is actually a bad word for what really happens. I don't see why. We can really only detect reasoning from external behaviour. You can't say "AI isn't reasoning because it's _just_ matrix multiplication/token prediction" any more than you can say "humans don't reason because brains are _just_ neural impulses moving around". > There are many famous voices in AI that have the same opinion as me. Many more that don't. > Where should consciousness arise? No idea! Nobody knows. > Nothing happens without a prompt and nothing happens afterwards, nothing is saved, nothing is changed? There’s no drive state, no homeostasis, nothing at stake. You can run AI continuously with one initial prompt. That doesn't seem like a big limitation. Things can be saved or changed - you can give AI long term memory by letting it write things down. It's a bit crap and unsatisfying at the moment (surely we can do better than that?), but maybe it's sufficient for consciousness. Maybe you don't need long term memory at all - was Memento guy not conscious? > It makes no sense logically That's true of consciousness in general, which is why it's such an interesting mystery. One which I suspect will never be solved. |
No reasoning has nothing to do with what we do. Humans can solve novel problems using sparse information. LLMs can’t do that.
Reasoning is a complex cognitive process that involves causal understanding, mental modeling, intentionality, and abstraction. Instead, transformer-based models statistically predict textual continuations based on patterns learned from extensive training data containing examples of human-written logical processes and problem decompositions.
LLMs produce outputs that superficially resemble human reasoning, but they are merely reproducing observed patterns rather than engaging in genuine cognitive reasoning.
Nope you can’t run an LLM continuously with one prompt, you are probably referring to agent harnesses, what in fact happens it sends additional prompts using a loop and asks in between if the goal is solved, for the LLM every request is completely new, you just add and add history to the prompt. no it is not real memory, an LLM doesn’t learn from each conversation, you just again add text to the prompt (which is history) up until the context window.
No but the guy has intent, has short term memory and has subjective experience, all which a LLM is lacking.