[jsheard]

> “Driving” is solved. Driving with humans on the road - doing unpredictable human things - is far off still.

Plus there's serious questions about liability with self driving cars which are still unresolved in most of the world - if the goal is to have vehicles operate themselves with no human supervision, who goes to jail when they kill someone? Despite all of the progress that's been made with AI it's mostly been in low-stakes problems where failure isn't a big deal, so we don't have a consensus on what we're supposed to do when a neural network negligently obliterates a person because some logistics company wanted to save a few bucks on driver salaries.

[ghaff]

The answer almost certainly has to be the manufacturer. I'm sure not responsible if my properly maintained and used self-driving car kills someone. That said, it's a novel area that doesn't have a clear analog to other products today.

[jsheard]

There's also the question of incident response, if a human driver "malfunctions" you take them out of service and the rest of the world keeps going, but if a self-driving model malfunctions there are potentially millions of vehicles running the same software ready to make exactly the same mistake until the issue is isolated and fixed. Should we ground the entire fleet of vehicles running that software until the issue is resolved and software re-certified, if the software is demonstrably dangerous? How much would that cost?