[27183]

> I think you've already conceded that LLMs demonstrate emergent behaviour

No. Please don't put words in my mouth. What I said is that an LLM compresses a bunch of information into a semantic embedding space and then does sort of a stochastic search in that embedding space. Any similarity to "intelligence" is accidental. You may look at the results of that process and "see" thinking or reasoning or something, but it ain't there.

> "intelligence" ... agentic ... usefulness

I don't think LLMs need to be intelligent to be (at least narrowly) useful. No more than random forests or genetic algorithms do at least.

[edit] Look, this has devolved to the point where it's no longer productive to continue. If you're going to state things like this as fact, there's really nothing more I can do here:

> emergent behaviour is reliably replicable

Go collect your Nobel prize then! This is no longer a discussion grounded in reality.

[sudb]

> but it ain't there

On what grounds? I don't think you've provided any evidence other than LLMs can't "adapt" or "learn" to show that LLMs do not show intelligence in any way. I think it's clear that there must be some emergent form of intelligence over words from just the agentic coding ability alone. I am not claiming that LLMs are intelligent, only that they display aspects of what we understand as intelligence.

> I don't think LLMs need to be intelligent to be (at least narrowly) useful

I agree! But they are more than narrowly useful, and they absolutely do not belong in the same category as random forests or genetic algorithms!

> Go collect your Nobel prize then! This is no longer a discussion grounded in reality

Once again you are being condescending while misrepresenting my position. The emergent aspects of "intelligence" have been replicated by virtue of independent LLM vendors training their own models - I am not making a stronger claim, you have misunderstood me.

Thanks for participating.

[layla5alive]

@sudb, I salute your effort. It is unfortunate how little this person took from your attempts at a genuine exchange.

Without moving goal posts: @27183: the word intelligence is defined as "noun. The ability to acquire, understand, and use knowledge."

LLMs can absolutely do this via in-context learning. They can even persist this as mementos on disk and re-attend to it later if its been purged from their context window.

You might try to make some comment like "they're not learning in the way humans do, they're not changing their weights, and they predict token by token!" Who cares? That's semantics - LLM attention is able to accumulate contributions of tokens and weights mixed together head by head and layer by layer with non-linear activations which functionally quack like intelligence.

They may be far different from us, but they're functionally intelligent (at least in several subsets of intelligence. And frankly, in some cases, they're more functionally capable than many humans).

Birds, planes, helicopters, rockets and gliders don't achieve flight in the same way, or have remotely the same capabilities in the air - but all are nonetheless forms of flight.