[AdieuToLogic]

> I suspect hallucinations in LLMs are the result of contradictions in their training sets which were trained into it.

A simpler explanation, and I posit a correct one, is people anthropomorphize an algorithm by describing the result of a particular path within a statistical model used to generate tokens as being "hallucinations" due to them being unexpected by the person interpreting the text.

> I suspect it's just like with humans.

Therein lies the problem.

[geon]

Yes. ”Hallucinations” are not an edge case or an error mode, but part of the normal operation of the llm.