Hacker News new | ask | show | jobs
by chezelenkoooo 1163 days ago
The author touches on this in the very article linked. His point is that the low accuracy answers provided by ChatGPT risks reinforcing the doctor's biases and then not thinking outside the box. In other words it risks the doctor blindly trusting the AI too much.
1 comments

The inherent problem with chat bots is you can't investigate why they're telling you something. When I search Google, I'm critically evaluating the information, and it's frustrating when the results it gives are low-accuracy. If I ask a chat bot a question, what would I do with the answer if it might be wrong? There's no context for me to evaluate.
You can ask it to explain its reasoning. And it's even more useful if you ask it to show its reasoning when you ask a question, as it improves the answer.
True, though I said investigate, not interrogate. In the context of the pre-bias example I was responding to, it's fine to integrate it into a search engine to assist with guiding you to sources of information, but it shouldn't manipulate the information by describing it to you, even if it also provided source links.