Hacker News new | ask | show | jobs
by dcj4 1165 days ago
No we don't.

I treat ChatGPT like a person. People are flawed. People lie. People make shit up. People are crazy. Just apply regular people filters to ChatGPT output. If you blindly believe ChatGPT output and take it for perfect truth, someone likely already sold you a bridge.

2 comments

> Just apply regular people filters to ChatGPT output.

This is technically correct, as LLMs are just aggregations of texts people produce.

It's also not quite right, as people have expectations/biases about how responses from computers might be different, and interaction with computers is missing many pieces of context that they might rely on to gauge probability of lying.

Telling them "ChatGPT can lie to you" is a succinct way of recalibrating expectations.

Actual people are also likely to tell you if they don't know something, aren't sure of their answer, or simply don't understand your question. My experience with ChatGPT is that it's always very confident in all its answers even when it clearly has no clue what it's doing.
Lol no they're not. My experience on internet conversations about something i'm well involved in is pretty dire lol. People know what they don't know better than GPT but that's it.