[DiogenesKynikos]

The LLM is the model + context. The output depends on both.

You're making an artificial distinction. The LLM sees a new programming language for the first time, and can immediately code in it. That's learning by any reasonable definition.

If you go past the context window, it forgets, which is a limitation of current LLMs. But as long as it learned how to code in the new language within its context window, it has gained that new ability.

[daveguy]

The context is the input to the LLM model. It seems like you need to study up on how LLMs work, instead of spouting hype.

[DiogenesKynikos]

It sounds like you need to be less condescending and engage with my actual comment.

First, the "hype" is not externally imposed. It's the genuine reaction of hundreds of millions of people to a technology that would have been considered science fiction just four years ago. The fact that I can't be certain you whether you are an LLM or a human is incredible.

Second, the output of the LLM depends on both its weights and the context. If it has seen something in its context window, it now knows it for all intents and purposes. It learns, in other words.