[fear91]

ChatGPT 4:

Ten elephants would have a total of 32 legs if two of them are legless.

Analysis:

# Calculating the total number of legs for ten elephants, considering two of them are legless

# Number of legs each elephant normally has legs_per_elephant = 4

# Total number of elephants total_elephants = 10

# Number of legless elephants legless_elephants = 2

# Total number of legs # (Total elephants - Legless elephants) * Legs per elephant total_legs = (total_elephants - legless_elephants) * legs_per_elephant total_legs

[opheliate]

Was this its raw response to the same query as in the OP? It seems odd it would provide a response using variables named with underscores, rather than using spaces, or more traditional algebraic notation (x/y/z).

[AndroTux]

ChatGPT (paid version at least) writes a quick python script in cases like these, and then executes it to get the result. For transparency, the script is shown in the output as well. Probably to avoid embarrassments like the ones we saw above.

Example (expand the program by clicking the little link at the end of the response): https://chat.openai.com/share/31e9a077-4c24-4c17-b30d-8d0c4d...

[bhaney]

It's cool how rapidly these oft-called "fundamental problems with LLMs" vanish with bigger/better models.

[8organicbits]

GPT-4 examples elsewhere in the comments suggest otherwise.

[ahahahahah]

That's just you showing that you clearly misunderstand. These aren't examples of fundamental problems, instead they are clear examples that these things are just autocomplete regardless of how many people think they are doing something more complex. It's not that getting the example correct is interesting, it's that getting it wrong is a clear sign of stupidity.

[8organicbits]

Did you use the same prompt?

[fear91]

Yes, I copy pasted it (How many legs do ten elephants have, if two of them are legless?).

[sp332]

Even the small Mixtral model gets this one right.