[Terr_]

What about the difference that the human knows what they don't know?

In contrast, the LLM knows nothing, but confidently half regurgitates correlational text that it is seen before.

[famouswaffles]

As far as all the research on this goes, LLMs (internally) mostly know what they know, but incentivizing that information making it to output is difficult.