[bagful]

I am comfortable asserting that an LLM like GPT-4 is only capable of thinking in language; there is no distinction for an LLM between what it can conceive of and what it can express.

[whimsicalism]

It certainly "thinks" in vector spaces at least. It also is multimodal, so not sure how that plays in?