[Torkel]

Multimodal models are not limited by semantic understanding though, right?

They are given photos, video, audio.

[elzbardico]

For them, it is all a stream of tokens, roughly speaking.