[mjewkes]

Apples are better than bananas. Cherries are worse than apples. Are cherries better than bananas?

--

GPT-4 - wrong

gpt2-chatbot - wrong

Claude 3 Opus - correct

[93po]

what's the right answer? my assumption is "not enough information"

[aluminum96]

What, you mean your fruit preferences don't form a total order?

[7734128]

Of course they do, but in this example there's no way to compare cherries to bananas.

Grapefruit is of course the best fruit.