[seba_dos1]

Why would anyone expect a language model to admit that it "doesn't know" (unless explicitly asked to)? That's not what it's for. It's there to put together a string of words that's plausibly looking like an answer for a given prompt - that it can sometimes successfully reach for facts it was trained on while making up the answer is an added bonus, a side-effect of how it works.

[gattilorenz]

Because your understanding of the capabilities of a large language model, and the general understanding, popular reporting and (to a certain extent) even OpenAI’s claims are going in two different directions.