Hacker News new | ask | show | jobs
by teaearlgraycold 762 days ago
I don’t know enough to make absolute statements here, but deep learning models can beat out human experts at discerning between signal and noise. Using that to guess at data and then hand it off to humans gives you the worst of both worlds. Two error probabilities multiplied together. But to simply render a verdict on whether a condition exists I’d trust a proven algorithm.
2 comments

Yes, pattern recognition is one of the applications ML shines at. Now the question was about using ML to extrapolate between sparse pixels and how much humans can rely on the added detail.

The goal would be to find a way to make ML extrapolate only pixels that really describe actual really present features and never imagining detail that wasn't there in the first place. Now I am no expert at the matter, but what I know of deep learning models they are really good at the latter as they basically make statistic guesses on what would be plausible.

Getting a plausible guess on what looks like a convincing answer works really well for answering a question. But the problem at hand is more like predicting the words someone said based on the first and last word in a sentence. Imagine a criminal case where the evidence is fragmented like that: I am pretty sure a LLM could give a convincing prediction here, but I am not sure how much you could rely on that prediction being reflective of what was actually said. I certainly wouldn't feel comfortable with a conviction the result of that prediction even if it was reflective of the ground truth in 90% of times.

There are a lot of models that are simply good at that without hallucinating nonsense. LLMs are a specific thing with their own tradeoffs and goals. If you have a ML model that says how much does this microscope photo look like an anomaly in this persons blood on a scale from 0-100 it can certainly do better than a human.