[ars]

> impatient overrides

It's not impatient. It's the car having no idea what to do next, so it just sits there waiting for something to happen.

I count that as a failure in the path to autonomous driving. Remember: Those 1% scenarios are the hardest part, yet they are critical. You can't just say "99%" it's good - after all humans drive perfectly 99.999% of the time (measured by time on the road vs assuming 5 minutes per accident - which is probably high, since the error leading to the accident probably took less time than that), yet that's not good enough.

[taneq]

We need to distinguish between the two.

For any kind of self-driving vehicle, making a silly mistake and needing a human to override it to prevent a collision is not OK at any significant frequency. I'd guess the maximum acceptable rate would be no more than one collision in multiple years of driving.

For a self-driving private vehicle with manual controls, pulling over and saying "help me, human!" once every few months is perfectly acceptable. For a standalone self-driving taxi with no manual controls, it's not. For a self-driving fleet taxi with a remote operator able to take over and help it when it gets stuck, it may be.

[akira2501]

> We need to distinguish between the two.

More than that, you need to distinguish between accidents and fatalities and then you need to put them both against the number of miles driven. In the US we're currently at about 36,000 fatalities per year with about 3 trillion miles driven.

> I'd guess the maximum acceptable rate would be no more than one collision in multiple years of driving.

Again.. terrible metric. The rate versus the number of miles driven _while in autonomous mode_ is what you really want to consider; and anything worse than the current numbers is absolutely unacceptable.

> For a self-driving fleet taxi with a remote operator able to take over and help it when it gets stuck, it may be.

I'm not sure that's better, or an acceptable solution. Remotely controlled, how? Do we put limits on that system? Are limits always a good idea given the context it's expected to be used in? How long between alert and remote control? What's the expected latency of drive controls, given that light actually moves pretty slow relative to the planet's size? Then, how do we secure any of that?

Either the system works better than humans, or it shouldn't be deployed. Limited trials, a good grip on the numbers and a strong regulator are what's needed.

[ars]

> no more than one collision in multiple years of driving

That's really high, that's worse than what people do (on average a person will probably have an accident every 18 years, none fatal).

And that's with a person watching? That's really bad.

> once every few months is perfectly acceptable

Not really. The people inside it will have no practice (or even ability) at driving. Such a car is not really useful, you'll just make things more dangerous, not less.

The bar for self driving cars is so incredibly high, I doubt you'll see them on regular (non-instrumented, restricted) city streets until we have true AI.

Most likely there will be train-like intercity roads, dedicated (and instrumented) for self driving cars and trucks.

But unrestricted city driving? Very unlikely to ever happen.

Despite how high the accident rate is, people are actually really really good at driving. And computers are really really bad at being reliable.

When you can have a complex computer program that simply manages to have 99.9999% uptime, then we can start to talk about self driving cars. We don't even have that, self driving cars are an impossible dream.

And that 99.9999% number is not just random, it's how good you have to be to beat a human at driving.

[kurthr]

Hmmm... I think I read the same insurance statistic and the number was 17.9 years, which is close enough. The concerning bit was that the number came from insurance claims not accidents, which might be under-reported, because nobody wants their insurance to go up! As a result many parking bumper dings, minor side swipes of other cars, bicycles, and pedestrians probably aren't reported.

Otherwise, judging from the bumpers of most cars in NY/SF... I would guess that each person had filed hundreds of claims.

[Judgmentality]

What about self-driving trucks on highways?

[carlmr]

>Despite how high the accident rate is, people are actually really really good at driving. And computers are really really bad at being reliable.

Human swarm behavior is terrible (that's your rush hour traffic for you). And computers are very very reliable. The only question is whether they can be programmed in a way to handle enough edge cases to be feasible.

I'm with you in thinking that for the next 20 years we'll see a lot of automation on high ways but not in cities. On the highways there's very much less variability, and less erratic human driving. For me that's already 99% of what I would buy a self driving car for. I'm happy driving short trips through the city. I hate driving home for 2-3h and not being able to do anything else.