[jqpabc123]

I posed this exact same test problem to a selected LLM.

It produced the correct answer --- including pointing out the irrelevance of the "smaller" kiwis.

Then I changed the person's name (John instead of Oliver) and jiggled the numbers a bit. It confidently produced an answer including an explanation with the irrelevance noted --- but it still did the simple addition wrong.

It obviously doesn't *understand* anything. It just regurgitates what it finds posted somewhere on the internet.

Frankly, I wouldn't trust anything it says. It's hard to imagine what this would be truly useful for --- propaganda maybe?

Billions and billions of dollars are being wasted on this.