[minimaxir]

That's the one thing very consistent with Transformer models, even GPT-3.