[stochastic_monk]

See also Attention is Not Explanation [0].

[0] https://www.aclweb.org/anthology/N19-1357

[physicsyogi]

There's a rebuttal to this as well: Attention is not not Explanation. https://arxiv.org/abs/1908.04626

[abhgh]

Thanks!