[nextfx]

I assume the name is referring to the Nyström low-rank matrix approximation.

[throwawaymaths]

Yannic kilchers explanation of the nyströmformer is really good and clear (though it might help to understand transformers to start out with) https://youtu.be/m-zrcmRd7E4