[jerlam]

Autopilot in aircraft have a similar problem, which led to the Air France Flight 447 crash in 2009. The airspeed indicators froze over, the autopilot switched from "normal law" to "alternate law", and the pilots failed to understand that the autopilot's protection from stalling no longer applied. They did not have enough training (or were too confused) to fly without the help of automated aids and flew the plane right into the ocean.

Boeing's planes were known for having fewer of these automated aids and thus required more skill to fly the plane, but the 747-MAX debacle threw cold water on that idea.

[throwaway894345]

Of course, (unlike some commenters in this thread) the air travel industry thankfully had the good sense to look at autopilot on balance rather than fixating on a single fatal accident (or in the case of Tesla's Autopilot, the mere possibility of a fatal accident). The salient question isn't whether or not an autopilot allows for any fatalities, but rather whether or not it reduces fatalities relative to manual piloting/driving.

[kewrkewm53]

Yep, autopilot is a good helper but a bad master. In the air there's a lot more space and fewer objects to avoid than on the roads, yet nobody has managed to build a perfect autopilot that could really replace pilots in every situation. I remain skeptical that we'll ever see one in any dimension, let it be air, sea or land.