Hacker News new | ask | show | jobs
by nkrisc 30 days ago
Most people should have learned at a young age that absence of evidence is not evidence of absence. My 8 year old understands this. After all, you can rarely ever prove something does not exist, only that it is unlikely to exist.

If a report states that X was not found, it does not mean X did not exist, it means it was not found.

What may be lost on the layperson is the nuance and understanding of how thorough or not a particular scan is and how much weight to give the findings and thus the odds that the report is correct.

6 comments

This is - by far - the most stupid stuff I've read on the internet the past few days. They didnt find cancer either (as well as a plethora of diseases that could be related to the symptoms), and afaik its not in the report.

Yah you can argue that the tool is not ideal for that diagnostic, yadda yadda. I get it, and in the end I agree with the subtle difference you highlight, because it is something that makes sense to a certain kind of people. You know how many medics would read the report exactly like the author did? Too many.

How do I know? Im not in a wheelchair after being constantly misdiagnosed by using the wrong imagiology technique by (mostly) chance, and a good help from friends, including a surgeon. This seems to be a case where AI would be a valuable doctor tool for differential diagnosis; instead we have know-it-alls that can't bother to verify, and AI that often gets details wrong. That is the problem.

I think it’s the combined depth AND breadth of knowledge that can be captured by AI models that is going to make them way better than most humans at this kind of stuff.
It's like when finding out about the sex of your baby via ultrasound before they're born. If you're told it's a boy, you can be pretty certain you're getting a boy. If you're told it's a girl, you shouldn't get too attached to the idea. The ultrasound tech might just have missed the evidence your baby was a boy.
> Most people should have learned at a young age that absence of evidence is not evidence of absence.

I’m fairly sure that there are no lions in my house. Lions are quite large and I’m capable of detecting lion sized objects with my eyes.

To demonstrate that something is not present you first define the object, then come up with a test that will reliably detect the object. If the test comes back negative then the object is not there.

In a strict philosophical sense I cannot prove that there are no lions in my house, the external world might not exist! A hypothesis that no one has thought of might be correct and that hypothesis could show that there are invisible lions in my house!

However I intend to act with the certainty that there are no lions in my house. Because I have no evidence of lions in my house.

Absence of evidence is evidence of absence.

"Calcifications not found" is a different statement from "no calcifications".

Even then, the context that "ultrasound isn't a great way to assess for calcification" is important when reading either statement. Laypeople don't necessarily have that context.

But the problem was that the report is not saying "not found", it is saying "is not present" or "there is no X".

And I think we can easily have examples where we can reasonably trust this, and a spectrum of such.

E.g. there is a math solution and the report says "there is no errors in this solution", you would imagine that to be quite reliable, no?

> Most people should have learned at a young age that absence of evidence is not evidence of absence.

That might be true, but it is definitely not the world we live in.