[probablybetter]

Please name me one technological advance of major import in the fundamental transformer kernel space that has occurred in the last decade that has any import at all on today's LLMs.

I will wait.

[RevEng]

The very idea of the Transformer architecture. Surely you've heard of "Attention is all you need".