Hacker News new | ask | show | jobs
by bathtub365 244 days ago
If these rates are known it would be great for OpenAI to be open about them so customers can make an informed decision
3 comments

OpenAI has published a great deal of information about hallucination rates, as have the other major LLM providers.

You can't just give one single global hallucination rate since the rates depend on the different use cases and despite the abundant amount of information available to people on how to pick the appropriate tool for a given task, it seems very few people care to take the time to actually first recognize that these LLMs are tools, and that you do need to learn how to use these tools in order to be productive with them.

OpenAI goes into great detail on hallucination rates of GPT5 models versus o3 in the GPT5 System Card [1], section 3.7.

[1] https://cdn.openai.com/gpt-5-system-card.pdf#page12

"Known" implies that these rates are consistent and measurable. It seems to me, that this is highly unlikely to be the case