[wpietri]

And I think that's due to a "let's keep driving" bias. In Uber's crash, for example, it detected an object moving in the road, but didn't understand what it was. Any reasonable human driver would have quickly stopped until it was clear what was going on. But the Uber car just kept going at speed until it was sure that it was a pedestrian, at which point a collision was inevitable.

I think the right thing to do is to invert the bias. If the car isn't sure it understands what's going on and that it's safe to proceed, it should stop. In which case, development becomes a long series of teaching about rarer and rarer circumstances, so it needs less and less human input to understand the road.