|
|
|
|
|
|
by godelski
784 days ago
|
|
|
> The instructions are prompting it to proceed rigorously, as it is a logical problem, not a natural language problem. I think you're missing a bit here. Look at the middle tweet where the person constructed it fail the logic. There are no tricks. What you're missing is the signal you're giving it, how it is spoiling the question in a subtle way. That's very different that a reasoning machine. We can't trust it to reason if it can only "reason" when we give it explicit instructions to do so that do not generalize for many tasks. That's not really reasoning... > OpenAI could train or tune ChatGPT to "spoil" itself by default They have and it's provable |
|
|
They are trained a certain way to perform specific types of tasks, primarily natural language processing tasks. They have necessarily learned some methods of reasoning in order to do what they were trained to do. No one is pretending that these are symbolic logic mechanical theorem provers. They are tuned a certain way to respond in a specific manner and they only do what they are told. If you want it to use reasoning then you need to tell it to use reasoning. It's a chat bot running on a neural network and it is not self aware.
Hopefully the next generation of AI will be more reasonable. We are not there yet.