Hacker News new | ask | show | jobs
by thefourthchime 1122 days ago
Sigh, I'm getting very sick of hearing about how "ChatGPT" makes stuff up. Yes, 3.5 made a lot of stuff up, 4.0 still does, but it's much rarer.

I wish people would mention this, it's all treated as the same thing. It's like talking about how unreliable these "Airplanes" are when they are talking about prop planes, even though jets are out.

8 comments

If I had an airplane that usually flew just fine as long as I didn't use it for business, but would sometimes crash directly into the ground for no apparent reason, I would be talking about how unreliable it is too. Especially if the maker of the airplane touted its unusual benefits for searching for information in a business setting.
I'm so sick of seeing this strawman. "Well, ChatGPT 4 is better!" Well, how should I know? I'm not paying for ChatGPT 4. At least a product like Midjourney is consistent both in its paid and unpaid form.
These are generative conversation bots. Their #1 priority is to make things up.
except ChatGPT 4 makes a ton of stuff up too. Rarer? Slightly. But the stuff it makes up is even more plausible sounding and harder to catch.

The improvements, in practice, are in the stuff it doesn't hallucinate. LLMs as a whole are still to be treated with great care.

Every post that is even remotely critical of ChatGPT has someone posting this exact sentiment like clockwork. It's probably just mindless fanboys, but I'm genuinely starting to wonder if it's some kind of astroturfed ad campaign for OpenAI.
Most people are using 3.5 since that's the free model.
The difference is vast and somewhat irritating to those with GPT-4 access today, but it’s also besides the point. The only people who deserve to cringe at the conflation are OpenAI’s marketing team, but even they may take solace in the sheer cut-through of column inches their cloven brand obtains, no doubt anticipating a future retirement of GPT-3.
None of this reporting or line of criticism is good and I completely agree, but it is worthwhile to remember that most users are using the free version and so to most people that's what ChatGPT is.