[somewhereoutth]

We humans see and digest much much more than just texts we have been given to read. Indeed, and texts are exactly the shadows on the cave wall that we create and share to describe and remember the world around us - but without direct experience of that world around us they can only be shadows.

Yes quite plausible that extraordinarily complex models are embedded in the text corpus, but these can only relate to the texts themselves, as that is all that exists as far as the LLM is concerned. Again, it should not be a great surprise that they correlate to our real world to some extent, but they cannot go beyond those input texts.