[croemer]

LLM written for sure:

> The identity [...] is the whole trick. The outer product is a matrix; the inner product is a number. We no longer store every past key and value. We store their summed outer products in the fixed-size state S_t.

[robertclaus]

Ya, probably started with asking for a buzzy title.

[geraneum]

This is what you get when you prompt claude to avoid –