humans at least are aware that they made a mistake and can avoid collision. Tesla makes no mistake, tesla has no idea whats going on so you cannot call it a mistake. Its not a bug, its a feature.
Except it gets reported back to HQ and like with airline accidents, the systems are updated across-the-board so that the risk of future occurrences is greatly reduced.
So instead of a single human learning "gee, shouldn't do that again", 100k+ vehicles learn about it.
Does Tesla actually do this? They should detect hotspots of people deactivating Autopilot (like in this video) and make Autopilot deactivate itself a few miles before
First we had the barrier crash. Then there was the video of someone reproducing the barrier crash and manually emergency braking. Now we have this video. One thing I've learned in my software career is that if one of our customers reports a bug, 10,000 others have encountered it but not bothered reporting it. So why hasn't Tesla rolled back the software yet?!
So instead of a single human learning "gee, shouldn't do that again", 100k+ vehicles learn about it.