[rafaelero]

Not using embeddings/lookup table means they can't generate image/audio, which to me it's a severe limitation. Why bother going to the process of generating a multimodal transformer if it's able to generate nothing but text?

[leodriesch]

For an AI agent that should navigate a computer (which is Adepts use case IIRC) it should work, as it only has to output commands.

[Philpax]

Many applications only need input, not output.