Hacker News new | ask | show | jobs
by js8 985 days ago
Probability is common, but not the only way to model uncertainty. There are also different logics, Dempster-Shaefer theory and so on. That aside...

Neural networks can be modeled with probability, but that doesn't mean they actually compute in that way. Just like with humans - we can see brain often follows things like Bayes rule, but it doesn't compute PDFs. Doing full probability reasoning would be too expensive for NNs to do, so they cut corners somewhere, and we don't really understand where, it might be very inconsistent. It often works but also often fails.