[Firerouge]

It's interesting, it seems to get stuck on a sentence or word a lot, then half the output is repeating a slightly varied sentence, or rambling about that unrelated word.

[minimaxir]

That's the one thing very consistent with Transformer models, even GPT-3.