[btilly]

Such errors are rare enough that they are almost never the most likely next token. Therefore ChatGPT only makes such mistakes when it is given good reason to do so.

[krainboltgreene]

ChatGPT cannot reason.