[nbardy]

I hate to be pedantic, but the llm is definitely doing embedding math. In fact that’s all it does.

[n2d4]

Sure! Although I think we both agree that the way those embeddings are transformed is significantly different ;)

(what I meant to say is that it doesn't do embedding math "LIKE" the OP — not that it doesn't do embedding math at all.)

[coolcase]

Yeah we'd be impressed if an LLM calculated the product of a couple of 1000x1000 matrices.