Hacker News new | ask | show | jobs
by dreamcompiler 2197 days ago
Whether humans or AI are "better" drivers is completely beside the point. The point is that we can characterize human drivers. We know where they succeed and where they fail, both in a statistical sense and in an individual sense based on their age, attention, vision, chemical impairment, etc. But we cannot characterize ML networks. We take it on faith that they work and then we find (because somebody dies) that they run right into an overturned truck or a pedestrian or under a truck crossing the road.

Until we can characterize the behavior of these systems, they must not be put in control of life-critical processes like driving.

2 comments

Just playing the devil's advocate but : when you take a taxi, what do you know about the driver? You can vaguely see if he's sober and that's all. You EXPECT him to have a driver's license, to have a good eyesight, etc but you KNOW nothing about it. If he has an heart attack while he's driving on the highway, could it have been predicted (by you or the company)? No.

So i don't see why this distinction between AI and humans is made : both are black boxes. Perhaps humans have less "edge cases" but as long as the error level of AI is the same or lower than the one of humans, I don't care if the car crashed because the human driver looked at a sexy woman on an ad on a billboard or because a variable was poorly set in the car's code.

I also agree on this. I think in terms of liability humans who one can sue when they make a mistake is more valuable than a machine.

That's why in life critical applications companies who are capable of taking the risk are scarce, because when accidents happen, the company has to take responsibility. It cannot be resolved by just firing employees.

You can fix a software, but you can only punish a human driver, hoping it will fix itself. Also, both can be forced to train, but you can reproducibly test only the software, no guarantee that your retrained human driver will not succomb to the same road rage in the near future.
Nonsense.

You can't fix a model to handle unknowns, and you can't test that.

We've seen with Tesla's autopilot software that things like obsolete road markers and overturned trucks are meaningless to software.

Of course you can!!

Even in something not very well defined as a neural network, you can try to retrain it, or also to modify its architecture, or its postprocessing, and verify reproductibly on test cases that it behaves better.

Also, to address your critics, you can add test cases (just like in any sotware. But actually they also do exactly that for hardware too).