[PartiallyTyped]

Attention existed before that paper and was incorporated to LSTMs until that point in time.