[Analog24]

"We can't characterise the type of mistakes that classifiers will make, or why those mistakes are, or aren't significant in an application. We can't engineer a machine learning system in the sense that we can't evaluate or certify that it'll work reliably or consistently."

These statements are false. It sounds like your extrapolating what you've read in a few blog posts and assuming that's how the entire industry operates. You don't read headlines about people digging through the data and error logs on a daily basis b/c it's not headline worthy but that doesn't mean it's not being done.