Hacker News new | ask | show | jobs
by priyanmuthu 1194 days ago
My worry is verification of facts. What if the model summarized incorrect facts, and it gets added to the medical history? How can doctors easily verify and fix things?
4 comments

Have you had a medical billing experience recently? They don't care about facts, they care about maximizing the bill subject to plausibility constraints.

I fear that LLMs will kick this to a whole new level :(

It’s easier to revise than to write a first draft. It’s possible to miss mistakes on review, but relatively, I think it’s more likely that a distracted human will mess something up on the first draft.
That's exactly the thought process that leads to us trusting LLMs in places where they shouldn't be trusted.
A good benchmark could be to compare the accuracy of generated notes to the accuracy of other currently accepted practices like human medical scribes and assistants.
Thanks for your comment. We clearly show a diff to the doctor before updating patient records. We are very explicit that they should check it (and edit if necessary).