[wahnfrieden]

It's only been the wrong task because they've been deficient at it and expensive to use, so we had workarounds. They are getting better at these tasks and cheaper (sometimes). It's fair to evaluate even if there are more economical and accurate alternatives available.

[fjdjshsh]

You can evaluate the limits of a spoon by trying to cut meat with it.

The point is what are the typical use cases for the tool / what are the agreed upon areas of application?

Making the LLM do math with large numbers, I would argue, is not in its typical use case, thought it's at the border.

Asking an image generator model to calculate numbers before running an image sounds definitely NOT like a reasonable use case (do people need it? Will people try using it for this purpose?)