[1maginary]

You just have to love Stephen Merity.

His work on QRNN's saved me quite a bit of time and money when I was doing my undergrad dissertation on language models.

This SHA-RNN seems to have surfaced from a similar line of thinking that spawned the QRNN.

[technics256]

Are qRNNs still used much?

[polymorph1sm]

check out MultiFiT [0] from fastai, it uses QRNN for speed.

[0] http://nlp.fast.ai/classification/2019/09/10/multifit.html