[eternauta3k]

Interesting, so the LLM is "just" getting your question plus a normal text description of the image (as vectors)?

[thewarrior]

At a high level yes.

More precisely - It gets the question After irs passed through a matrix that transforms the text description of the image so the LLM can “understand” it.

It maps from the space of one ML model to the other.