Hacker News new | ask | show | jobs
by seba_dos1 1100 days ago
Even for simple programming questions, its trustworthiness is absolutely near zero. It doesn't mean that the correct answer rate is near zero - it's actually not that bad, but it's absolutely not trustworthy as it often outputs correct-sounding total nonsense.

If it outputted "I'm sorry, I don't know how to do that" for every single question, you could consider it 100% trustworthy, even though it would be useless. As it is right now, you can expect it to output correct answers with some confidence, but you absolutely can't trust that a given answer is correct until verified (you should in fact outright assume that it's not until proven otherwise).