Hacker News new | ask | show | jobs
by pasabagi 1189 days ago
If you ask an idiot what he thinks about something, and he gives you a totally wrong answer, you have still learned at least one fact: a person believes a thing. As a human, living in a democracy, that has some worth. ChatGPT's wrong answer has absolutely no value at all.

Further, 10 different smart people will give 10 different answers because they have coherent worldviews and biases and proclivities, so by accounting for those, you can work out what the right answer is. Even if ChatGPT was anywhere close to a human expert when it comes to accuracy (what's the error rate in a peer reviewed journal article?) it would still have no coherent worldview or bias to contextualize its statements.

2 comments

I see what you’re saying. The world has lost its collective mind.

HN seems to want to hand over the keys to the kingdom to basically a string generator. The string generator believes nothing, understands nothing, knows nothing but here we are.

Any intelligence that gpt4 shows is an emergent property. Humans are the ones reading GPT’s output and imputing meaning to it.

Reminds me of astrology and mass hysteria - people convincing each other to give this new oracle a chance because they personally have seen value in its ramblings.

I understand what you're saying. I just thing the world isn't so black and white. When you ask the idiot, or the smart person for that matter, a question, you have no idea if they are right or not. You only know after the fact when you get enough data to prove them wrong or someone that you trust more than that person tells you otherwise.

What is your error rate? What is my error rate? All of this stuff is unknown because we don't have counter factuals and we don't think of the world in this way (Did you order the correct food at dinner? Did you wash your clothes at the optimal time?)

To me you're thinking of it as a classical deterministic (binary) computer rather than a probabilistic thing. It's not an oracle, or a miracle, or anything other than some thing that gives useful information some percentage of the time. If something has to be right 100% of the time for it to be useful, or even 60% of the time, then the world is missing out on a lot of value.

Investors are right ~51% of the time, startup founders in the aggregate are right ~10% of the time, a great batting average is ~30%, etc.