Hacker News new | ask | show | jobs
by powerhugs 496 days ago
> Chatbot LLM's don't have metacognition. They don't know that they don't know.

Correct. LLM also don't have intelligence. What you and others mistake for intelligence is a very clever prediction model.

A LLM don't reason at all. It only tells you what is a most likely response based on its training data.

This is why the LLM cannot tell you it don't know.

3 comments

People throw around the "intelligence" and "reasoning" arguments as if we have commonly understood and strict definitions of those concepts and don't constantly have issues of either including or excluding unexpected cases.

Maybe once we solve simple issues like "are cephalopods intelligent" and "are people deterministic prediction machines", we can start talking about classifying Ai capabilities...

> What you and others mistake for intelligence is a very clever prediction model.

It is not a very clever prediction model. It is a very big, incredibly large humongous model that finds stuff basically by brute-forcing pattern matching over almost all text we have produced in the past.

A clever model would get us similar results using the same amount of energy a human brain uses for that task, which is tiny.

Spot on. But unfortunately the AI grifters are now active and selling this snake-oil on to the rest of us.

> This is why the LLM cannot tell you it don't know.

To the untrained eye it appears that it knows everything about every question it answers when in fact those who are experts in their own domains can detect if it is hallucinated and generated complete slop.

"It’s over."

"We’re cooked."

Typical AI grifters’ clickbait intros.