|
|
|
|
|
by joe_the_user
308 days ago
|
|
The compiler analogy is seductive but problematic imo. A compiler can be fixed thing that does a fixed task. A cancer recognizer is something like a snapshot of people's image-recognition process during a period of time. These are judgement that can't be turned into set algorithms directly. There was a discussion a while about how face recognition trained with Internet images has trouble with security camera footage 'cause the security camera doesn't certain images. It sounds weird to say that what cancer looks like drifts over time but I'm pretty sure it's actually true. Demographics change, the genes of even a stable group change over the generations, exactly how a nurse centers bodies, etc. change over time and all these changes can add to the AI judgement snapshot being out of date after some period. If the doctors whose judgements created the snapshots no longer have the original (subtle) skill then you have a problem (unlike a compiler whose literal operations remain constant and where updating involves fairly certain judgements). |
|
The detector can be fine-tuned over time to improve accuracy and account for distribution shift. We should still have access to the same signals (did this turn out to be a tumor?) that doctors would use to update their own judgement.