[rawgabbit]

LLMs in my opinion is pattern recognition of text sequences at an almost infinite scale. My understanding is that "world models" is an attempt to replace the text sequences with more realistic approximations of the world. But they still plan to use pattern recognition.

In the meantime, humans would still need to do the reasoning.

[nextaccountic]

We do pattern recognition at an unconscious level all the time. When we perform a task using "system 2" of our mind we are rational and conscious, but when we perform a task using system 1 we do it automatically, intuitively and witu no effort. System 1 often relies on unconscious patterns matching

For example, a chess grandmaster can instinctively tell a good move when seeing a board during a real game. But if they see a random chess board that was not part of a real game, they regress to almost novice level at this task, because there are no patterns to recognize

(patterns such as tactics like pins and skews, or common mating patterns like backrank mate, or common pawn structures and corresponding pawn breaks, things like that - all those patterns can get recognized unconsciously)