[trompetenaccoun]

It's most obvious with simple math problems because we easily agree what the correct answer should be. But generally GPT3 puts out questionable replies. You can easily get it to contradict itself for example, but it doesn't do logic and doesn't see anything wrong. It often insists on incorrect output.

It's a problem when the general public who do not understand how it works treat it like actual artificial intelligence, when in reality it's a language model that puts words together in a way that they appear like natural language, regardless of truth.

I'm sure they're going to tweak it and fix the math problem soon, and probably some other very obvious issues. Already some topics are policed with Chat-GPT and it only returns politically correct answers. But that will only make it worse, not better. The less obvious it becomes, the more people will rely on it and regard the output as truth. While it's anything but that, at the very best it can give an overview of what the current group think and popular myths are, because that's the data it's been fed. The internet is full of misinformation.