[eli_gottlieb]

>Our key insight is that the diagonal linear recurrent layer can act as a gradient accumulator

So they're sort of reinventing the discrete-time differentiator from signal processing, but parameterized neurally?

[radarsat1]

Converging slowly on Kalman filters, calling it now.