[foxylad]

And when that bug is fixed, assuming modern update practices, it is fixed for everyone. In effect, human drivers can only learn from their own mistakes whereas autonomous systems learn from every mistake made by their system's drivers.

[rwmj]

But can you really fix a bug in a machine learning algorithm? Sure, you can retrain it on the data which caused the crash, but could that mean you created another bug somewhere else?

[rimliu]

That's exactly why I am not looking forward for self-driving cars. Rash drivers in most cases do know they are doing something stupid and dangerous (like going way over speed limit, overtaking where visibility is limited, etc.) AI on the other hand is prone to "honest mistakes" which can be deadly.