[divan]

Yet, this doesn't answer my question. Human brain is obviously has so much more in it (visual cortex for starters, grid cells etc), and, in terms of neural network, much more sophisticated architecture. But still, there is a big probability that what we call "knowledge" and "reasoning" and "conciousness" are just a result of this sophisticated architecture. I.e. there is no special magical thing for "reasoning" that next generations of prediction models can't replicate.

There is a faboulous book by Jeff Hawkins "On Intelligence" (2004) that explores this. I think main premise of it still holds true: brain is "just" a highly sophisticated hierarchical tissue whose main job is to extract patterns and make predictions. Fundamentally it doesn't seem very different from what LLMs are.