[pixelHD]

The transformer paper was quite influential in machine translation space. This resource [0] posted here a while back is a good place to learn and get a better idea how it works.

[0]: http://nlp.seas.harvard.edu/2018/04/03/attention.html

[lucidrains]

one of the best visual tutorials on the transformer I came across http://jalammar.github.io/illustrated-transformer/

[pixelHD]

Wow, that does look really good! Thanks!

[lucidrains]

you're welcome! :)