[thinkzilla]

The Attention Is All You Need paper deserves a lot of credit, but it also builds on other ideas. Earlier versions of attention were introduced in 2014 papers from (not U.S.) universities.