[adw]

Transformers have been industrially ubiquitous for a lot longer than GPT-3, initially in machine translation.

[mistrial9]

"a lot longer " quite the statement !

reading here says "the behavior and qualities of these large models is poorly understood"

prove me wrong?

ps- I agree that BERT-related models have been "wildly popular in NLP for years now"