Hacker News new | ask | show | jobs
by threeseed 756 days ago
Not sure what you are expecting.

The models are non-deterministic and there is no way to predict hallucinations.

1 comments

to be fair, a standard model is deterministic at temp==0.

And there is a way to predict the presence of hallucinations, but it’s expensive (SelfCheckGPT)

No. There is no way to consistently predict the presence of hallucinations.

It is at best 90% accurate.

Prediction implies inaccuracy

https://arxiv.org/abs/2303.08896