[mc32]

That kind of reporting is awful.

How is it they can’t either go to Wikipedia or one of the LLMs (despite hallucinations, tend to get simple things right) and get some corroborating evidence before making such basic mistakes on an article?

[Forgeties79]

Man I can’t even trust simple things these days from LLM’s. Hardly scientific but I just decided to do my own little test one time when I was on discord talking to some friends about The Game Awards back in December or so. ChatGPT would simply omit winners and/or categories - got it wrong (twice the same way, one unique way) 3 times. We tried Gemini, it gave 1 wrong answer and omitted 2 categories. It was impressive how much worse than a basic search they were at a simple “what were the results of the 2025 Game Awards?”

[simianwords]

You are right. ChatGPT doesn’t catch this, instead catches things like CERN having 25 member states instead of 24.

I would have expected it to catch it but it did not. I’m sure pro version would have though.