[evouga]

Right. Would we be impressed if a layman could pass the bar, given infinite time and access to the entire Internet (including the copious amount of bar exam study guides and worked example problems)? If not why are we impressed that a language model trained on that data can?

Meanwhile when I ask ChatGPT which of six numbers are odd, it confidently reports a mix of even numbers, odd numbers, and letters.

This is a fun milestone but the angst above about the “end of commoditized intelligence” etc. is unwarranted.

[curriculum]

Along the same lines, asking

> How many words are in the sentence "This is a test of artificial intelligence"?

yields an answer of:

> There are 8 words in the sentence "This is a test of artificial intelligence."

(There are 7).

[coderoffortune]

My guess is that AI omitted 'a' because this is essentially how natural language processing works. Perhaps it cannot see 'a' because the input has been stripped of 'a' or 'the', and so on.

[tandr]

Maybe it understood "odd" in a different sense of the word? As in "unusual", whatever the "unusual" is for an AI...