[anon373839]

I agree, it is unlikely we’ll be able to get LLMs to provide “informed uncertainty” because they can’t interrogate any internal confidence in the correctness of the output.

But I wonder if tuning the output to avoid definitive statements would be beneficial from a UX perspective.

[Terr_]

I think it would help curb people over-trusting the model, yeah.

Heck, imagine how terrible the opposite would be: "When answering, be totally confident and assertive about your conclusions."