[mrguyorama]

When the human continues driving in incliment weather, and runs into the back of a van full of kids and kills all of them, we put them in jail for making a bad judgement call.

How do we handle the AI mowing over a pedestrian when it makes a bad judgement call? Right now, the status quo is that we do jack and shit, and I can't help but feel like that's not a good plan.

[lallysingh]

The same way we handle a failed brake system. Bad maintenance or bad design, that leads to operator's or manufacturer's insurance paying.

[mrguyorama]

Car brake systems actually have several built in redundancies, including an entire secondary system for backup emergency use.

What redundancies can you implement in a black box "AI" model?

[lallysingh]

Automatic emergency braking is already available, unless some moron disables it.

[conductr]

It’s an interesting conundrum, but in a full AI world the hope is that it’s so rare we don’t feel the need to be punitive at all and can chock it up to bad luck and try to learn from it. Perhaps more similar to when a airplane crashes and people die.