[operatingthetan]

LLMs do not learn. You put it out to pasture and create a new one. "Memory" in a session is essentially a context window party trick.

[aetherson]

They learn during training, which is what we're talking about.

[operatingthetan]

>which is what we're talking about.

You are anyway, I don't see anyone up the chain saying that.

[chiply314]

They already learned. A lot or basically everything evern written and available digital.

And context window work very well. You can 'teach' an llm a new programming lanuage and other things through it.

[aspenmartin]

They do learn in context, and very sample efficiently. Continual learning is active area of research and we sort of already have something resembling it with persistent context. So yes they do learn.

[operatingthetan]

I consider that to be the illusion of learning. You are not wrong, I think they may actually learn in the future though. But not today.

[aspenmartin]

That’s strange to me, what would you define as learning?

[FromTheFirstIn]

To acquire new knowledge and build your understanding. They don’t understand so they can’t learn

[operatingthetan]

Thank you for saying succinctly what I could not. If your consciousness and knowledge fundamentally does not change from your ongoing experience, then you are not learning. This is how the LLM currently functions.

[lemiffe]

The LLM itself doesn't, but agents can research, compare, add to their memory, and use that to narrow the results down to a probabilistically higher set of outputs; I have used an LLM for my own MRI results and it was nearly spot-on, verified by a subsequent visit to a specialist. YMMV as they say. But I do believe we are entering the era where LLMs are considering past interactions and long context windows to inform it of personal preferences and history in order to output more accurate results.