[Retric]

Comparisons between providers is a separate issue.

Suppose you assigned people randomly to 101 doctors from 2 populations (A,B). Now suppose A was 10x as likely to die. D(0) get's 0% of A's and 100% B's. D(1) is 1A and 99B. All the way to D(100) that only get's B's.

In that admittedly simplified example you could determine that D(0) did a better job than D(100) by only getting 8x as many deaths even if 9.8x may be statistically irrelevant.

Yes, the real world is vastly more complex. But, while that may make a strict ordering impossible you can likely find out the best doctor is likely in the top quarter and the worst doctor very likely in the bottom quarter, which can be useful.

Picture a score card that said 80% chance in (0% - 20%], 15% chance in the (25%-50%], etc. That's not exactly meaningless information.

[nradov]

Nope that doesn't work because there's still no way to reliably control for the confounding factors. We don't even know what all the confounding factors are. Patients aren't randomly assigned to providers.

[Retric]

> Patients aren't randomly assigned to providers.

Sure, we don't have that information today. But, if we want to collect relevant information we could easily have a subset of doctors with random patient assignment. IMO, that's simply an implementation detail required if we want good information.

PS: US healthcare spending is over 3 trillion per year, rationally even minor improvements are worth large investments.

[nradov]

None of that is actually easy. Spend a few years working in a clinical environment and then tell us how easily it could be done.

[Retric]

I do work in healthcare for HHS this is very much the kind of thing we do. Change is hard, data collection is significantly easier.