Hacker News new | ask | show | jobs
by northern_lights 3539 days ago
Many people might not understand just how busy physicians are, and how difficult it can be to integrate a new product into the clinical workflow.

The most pressing thing to understand is that clinicians spend the VAST majority of their time gathering all of the necessary information to make a diagnosis. In other words, they aren't puzzling over how to diagnose about 85% (made that up) of their patients.

Once the necessary information is gathered, an experienced doc doesn't usually spend more than about 10-15 seconds debating different diagnoses. Therefore, if your tool takes more than 10-15 seconds to launch, enter any necessary data, and get a result, you are slowing the clinician down and they won't use it. This is why automated EKG interpretations (which are very much a real thing used at hospitals across the country) print directly on the EKG printout - it doesn't cost the clinician more than about 2 seconds to read what the machine thinks and adjust their interpretation accordingly[1].

One of the major problems limiting adoption of "expert" computer systems is the amount of (very expensive) integration it takes to get them under that 10-15 second limit. One of the big reasons radiology is seeing a lot of buzz around machine learning and automated interpretation is that integration becomes a lot easier when you can just feed in an image and maybe 5 words about the indication for the study.

I would love to go on for a while about this stuff, but I'll stop there for now :)

[1] Some people here might be interested to learn that non-cardiologists generally don't have negative views about automated EKG interpretations. But we are also very well-aware that when we make decisions about a patient, those decisions have to be anchored to something a lot more substantial than "the machine told me to do it."

2 comments

One way to think about AI's potential impact is less about replacing what physicians do well currently, and more about doing things they can't do at all.

Take ECGs -- it's true that in a hospital, an automated ECG interpretation doesn't buy you much. But what about about the patient with a paroxysmal heart rhythm that doesn't show up when they're at the doctor's office?

I was at a patient conference recently, and people were describing the first time they felt atrial fibrillation (a common abnormal heart rhythm). Many times, by the time they got to the doctor, they were back in sinus rhythm and thus the ECG showed no abnormality. Some were told they were just feeling "anxious" or "going through menopause." It often took months of persistence just to get a diagnosis.

Now, if have cheap sensors + AI analyzing the patient's whole heart history before they walk in the door, you can do a lot of good for real people.

To address your example directly - we already have holter monitors that would show a case of atrial fibrillation quite easily. They aren't terribly expensive, at least for something that has to have FDA approval, and they are frequently used. Heck, you don't even need "AI," in the sense of neural networks/machine learning/some other buzzword. Current systems will review a strip collected over several days and flag any abnormal rhythms.

The problem comes with determining who to put on a monitor. In the case of the patients you described, it's actually quite likely that the doctors seeing these patients considered the possibility of afib. The symptoms, though, can be very vague, and they are seen nearly every day in the doctor's office. It's simply too expensive to put every patient on a holter monitor - the doc's office has to be paid to maintain the monitors (which people abuse at home), the nurses have to be paid to teach patients how to correctly wear them, the monitor company has to be paid for whatever absurdly expensive and proprietary review software they supply, and the prescribing doctor (oftentimes the prescribing cardiologist) has to be paid to review and confirm the machine's interpretation.

All of this for a transient rhythm which any second year medical student would easily recognize if presented the EKG from across the room.

The sad reality is that the patients you described were experiencing the system as it is "designed" (I use the term loosely) to work. The fact that someone is persistently seeking help for their problem dramatically raises the probability that something is truly wrong, and doctors actually recognize this and take it into account. This is one of the reasons it's considered best practice to establish a long term relationship with one doctor who knows you well, but it's harder and harder to do with insurance companies only reimbursing for 15 minute visits.

What kind of information do they gather, and can that be automated?
One of the challenges of medicine is that the information is gathered from so many sources and is so "fuzzy" in quality.

Building a "database" of information from which to make a diagnosis is unlikely to be easily automated. Take a straightforward case of a patient who comes to the emergency department after "fainting". Did they slowly kind of "melt" to the ground, or did they just BOOM fall? Were they confused after they woke up, or just a little sleepy? Was it a hot day or is it wintertime? Were they wearing a shirt and tie, or a t-shirt? Different answers to each of these questions will change the probability of each potential diagnosis. The signal:noise ratio is frequently very low, and there's not a great way to improve it without adding an extremely large amount of cost and time to an already expensive and slow healthcare system.

Good clinicians already have an idea of the top 2-3 most likely possibilities before they walk into a patient's room, based on epidemiology and a quick review of a patient's chart, but we try to be flexible enough to discard those preconceptions if new info becomes available. Sometimes clinicians fail to fully investigate what a patient is telling them, and that's where the real mistakes get made.