[moultano]

I think LSTMs have been mostly abandoned. I don't see much new work using them, vs CNNs or transformers.

[phowon]

Aren't causal convolutions basically CNNs with masking?