Hacker News new | ask | show | jobs
by joseda-hg 694 days ago
One of the weirdest side efects of 4o vs 4, was single character "hallucinations" where a completely correct answer would be wrong specifically by a single character

I don't think I've seen anyone comment on it, but it was noticeable, specially when 4o was just released Has anyone noticed anything similar?

3 comments

Interesting. They switched to a new tokenizer for 4o and 4o-mini, so this might have the same issue.
I noticed the same problem but on 4, it was super-weird, everything was fine except one character, and it occurred consistently in the second and the next answers, never in the first one.
i saw this with github copilot a few days ago, not sure which model it was. it messed up a single character of markup causing the resulting output to be formatted weirdly