[Marha01]

LLMs fundamentally work by predicting the next word (token). But that should not be used to diminish their potential capabilities. It's like saying that human brains "just predict (or produce) the next electrical impulse". Fundamentally correct, but says nothing about the potential emergent capabilities of scaled-up systems that work like that.

Emergent properties of complex systems should not be diminished just because the underlying operating principle is simple.

[layla5alive]

So much this - so many people seem to miss the forest from the trees that emergent properties are not bound to the complexity of the underlying mechanics.

All of life arises (maybe) from very simple subatomic particles, and at each stage you can repeat this refrain, complexity increasing as you stack.

[podocarp]

True, but there are also some who push it too far. As with all things, take it with moderation.

[galaxyLogic]

Game of Life comes to mind: Most simple logic, emerging patterns are hard to believe.