Hacker News new | ask | show | jobs
by mojuba 86 days ago
Good quote:

> AI should learn to say two things: ‘I don’t know’ and ‘you’re wrong.’

My guess is, the next evolutionary step of LLM's should be yet another layer on top of reasoning, which should be some form of self-awareness and theory of mind. The reasoning layer already has some glimpses of these things ("The user wants ...") but apparently not enough to suppress generation and say "I don't know".
2 comments
IshKebab 86 days ago
Well they managed the "you're wrong" bit at least. Sometimes ChatGPT tells me I'm wrong when I'm not. Still can't do "I don't know" which is probably the bigger problem.
link
anilgulecha 86 days ago
Claude models have made very good progress (see BS benchmark), and that probably explains why they're leading now. others will follow this precedent shortly, no doubt.

https://petergpt.github.io/bullshit-benchmark/viewer/index.v...

link