[somewhereoutth]

But it is being given only those texts, not the circumstances. All that is can do is associate and surface patterns in the texts - very complex though those patterns may be. It should not be surprising that those patterns are recognizable, and even that they appear 'real', as they are derived from text about our world. However there cannot be any understanding beyond that, just as with the shadows on the wall of Plato's cave.

[dwaltrip]

Are you arguing the humans are not merely looking at the shadows on the cave wall but LLMs are? Or that the shadows that the LLMs sees are fundamentally different / worse than ours?

> All that is can do is associate and surface patterns in the texts - very complex though those patterns may be

One of the more interesting ideas I’ve heard is that text contains embedded world models that are far richer that we previously imagined. We missed this because it is something we take entirely for granted and couldn’t imagine it any other way, like a fish who doesn’t realize they are swimming in “water”. This seems like a very plausible explanation for the performance of gpt-4 and the like.

[somewhereoutth]

We humans see and digest much much more than just texts we have been given to read. Indeed, and texts are exactly the shadows on the cave wall that we create and share to describe and remember the world around us - but without direct experience of that world around us they can only be shadows.

Yes quite plausible that extraordinarily complex models are embedded in the text corpus, but these can only relate to the texts themselves, as that is all that exists as far as the LLM is concerned. Again, it should not be a great surprise that they correlate to our real world to some extent, but they cannot go beyond those input texts.