[gonehome]

They ignored repeated failures and evidence of malfunction by saying it was “impossible” that it could be failing in that way.

Unexpected failure modes are the issue. The Boeing 737 max 8 failure being tied to one sensor would suggest the industry has not fully learned the lesson.

[DaiPlusPlus]

My understanding is that it was a UX issue - the "malfunctioning" was the system working as-directed by the user, but the UX was horrible for informing the user what they were doing.

[gonehome]

It was a lot worse than that: http://sunnyday.mit.edu/papers/therac.pdf

That paper is long, but does a great job of giving the context and going deep on the details.

[DaiPlusPlus]

Thank you!