[gf000]

I don't know, that seems like a fundamental limitation. LLMs don't have any ability to do reflection on their own knowledge/abilities.

[ben_w]

Humans aren't very aware of their limits, either.

Even the Dunning-Kruger effect is, ironically, widely misunderstood by people who are unreasonably confident about their knowledge.

[gf000]

But you know if you have ever heard about call by name or value semantics.

[ben_w]

You've only ever seen people get upset about technical jargon they know they don't understand, but also never seen people misuse jargon wildly?

The latter in particular is how I model the mistakes LLMs made, what with them having read most things.

[eru]

Yes, Dunning-Kruger's paper never found what popular science calls the 'Dunning-Kruger' effect.

Effectively, they found nothing real but a statistical artifact.