Hacker News new | ask | show | jobs
by re 1130 days ago
Did you notice that it made multiple errors for the first two variations? [Edit:] What's particularly interesting to me is the inconsistent counting of apostrophes for #1, and the handling of "theory of mind" for #2 -- though there are simpler errors besides these.
2 comments

It has to do with the way text is tokenized into discrete groups and not individual characters. One way to try overcoming this problem is to ask the model to break each word into individual spaced characters as an intermediary step.
Not to mention a third one isn't any sort of argument, just a statement of the opposite belief.
The program Eliza could sucker a lot of people just by inverting pronouns and adding flavor text, e.g.:

Querent: my parents hate me

Eliza: Why do you feel that your parents hate you?

At a higher level, ChatGPT in that example is negating the provided text and returning something of opposite meaning but not doing much more.