[bcherny]

The reason humans tend to tell the truth is if we don’t, other humans will call us out for it.

I wonder if there’s a way to mimic this “bs penalty” for GPT. Maybe you could have a setup where GPT gives an answer, then a second GPT has to guess whether a human would know if that answer is true or not.

[dr_dshiv]

This I think is the approach—a dialectic of LLMs that can critique and synthesize.

Although, this will surely be a solved problem once we have TruthGPT, right? ;)