[daveguy]

One of the biggest problems in AI for the last 60 years is the grounding problem. The ability of a model to be rooted in objective reality. In other words, for one of these LLMs to understand when they are being accurate vs hallucinating. None of the current crop of LLMs has come close to solving this problem. On the contrary, they make the problem blatantly obvious. No LLMs will achieve AGI until this is solved sufficiently that the answers of an LLM can be depended on without complete independent secondary verification.

[mrguyorama]

A LANGUAGE model cannot solve this because truth and fiction is not a property of LANGUAGE

[majou]

In causal speech confidence in an answer is communicated; though maybe just as a pause, or even through tone.

Not the sort of data we'll have crop up in CommonCrawl.

[daveguy]

Congratulations. You figured out half the hype. The other half involves confusing a sigmoid curve with an exponential one.