It's a standard trope that anti-ai folk love to draw upon.
Hey look! I managed to get the AI to fail at some basic thing (after trying 1000s of times), it means AI is failing!!!!!
It's a total red herring and mispresents the current state of the models completely. It's like meeting a child prodigy in maths and then saying he's actually dumb because can't drive a car yet.
The truth is that they are tools for language manipulation. Advanced mathematics is language manipulation. Multiplication is not. Using it to describe them as having a critical flaw is a red herring. Using it to help people understand what these tools are capable of and how they function is valuable.
Hey look! I managed to get the AI to fail at some basic thing (after trying 1000s of times), it means AI is failing!!!!!
It's a total red herring and mispresents the current state of the models completely. It's like meeting a child prodigy in maths and then saying he's actually dumb because can't drive a car yet.