[beardedwizard]

Is that prediction not based on matching previous patterns, whose frequencies are more or less encoded in the weights?

[snapcaster]

you're really reaching for no apparent reason. Just move on from pattern matching machines it's not a good mental model for LLMs