Hacker News new | ask | show | jobs
by nomel 7 days ago
> For the human brain, there is no "loop centre" in the brain.

There are definitely cognitive feedback loops: https://pmc.ncbi.nlm.nih.gov/articles/PMC11903256/

Is your argument that, because they're external to the Llm, rather than integrated, they don't count, not even in a practical sense?

I think the result of the system is all that's important. Where/how it's implemented doesn't matter for practical results.

If the argument here is that LLM don't have this built in, you should know that nobody has a practical use for plain LLMs these days. Nobody uses them this way, except for debug. All interesting use is through some kind of harness, with all sorts of systems bolted on. I think these conversations are only meaningful in this "agent" context that people actually use LLM, where they stop when they think they're done.

LLM don't have a some self contained loop, like we do, sure. Who cares though. The actual AI system that we use every day definitely do.

1 comments

> There are definitely cognitive feedback loops

Have you read the article in question. It is saying that for one continuous thought, the brain will use different part of the brain to do different thing. It does not say that there is a "loop controler" anywhere. On the contrary, it illustrates that there is no loop controller: there is not special brain function that control this loop, this loop is "how the brain works", and LLM don't do that, they are incapable to do that, it is not how they work.

> Is your argument that, because they're external to the Llm, rather than integrated, they don't count, not even in a practical sense?

No, my argument is that the nature of the brain and the nature of the LLM are very different, as different as a real paper plane and a video game paper plane. Some characteristics (for example, awareness) that exist in the brain cannot exist in the LLM because these characteristics are the result of the nature of the thing in question.

The problem is not that you build a system by integrating 2 things together. The problem is that they are different "things", they are different machines, they function, fundamentally, differently. They may produce the same output, but when you say "the brain has the characteristic X, the LLM produce the same output, so the LLM also has the characteristic X", it is logically inconsistent.

Planes are built as a system combining 2 things: a motor and some wings. But they are fundamentally different from a bird. They just don't "work" the same. It is not the same mechanism.

> you should know that nobody has a practical use for plain LLMs these days

That is totally irrelevant. My point is about the nature of the LLM, and the fact that it is stupid to see the same output and to conclude that they have the same characteristic. It is like saying "Birds are flying in the air and are alive. Planes are flying in the air, so I guess they are alive".

> LLM don't have a some self contained loop, like we do, sure. Who cares though. The actual AI system that we use every day definitely do.

No, you miss the point. The problem is not that "you can just add an external loop". The problem is that the brain is a system that works without such control loop. The thoughts are flowing (and they may flow to different brain functions, like explained in the article you quote). It is part of how the system works. Having a system that contains 2 things, one that does one computation and one that control the loop is not equivalent to another system where you cannot decouple the "flowing of the thought" from the "thinking machine".