[inimino]

"Vaguely upsetting in how confidently wrong it is" is a good summary of ChatGPT in general, so the summary captures what ChatGPT is better than it captures what the article says. Very few humans are both capable of putting sentences together that coherently, and so incapable of a first-order understanding of the author's point. We don't have ready words for (or widespread recognition of) this kind of LLM-idiocy, because internalizing a probability distribution over words, sentences, and paragraphs without any correlated world model is not something humans do. "Bullshitting" comes close, but there's a difference of degree that becomes a difference in kind.