[denkmoon]

I feel that an engineer in almost any field should understand failsafe vs fail-deadly. Tesla's autopilot is definitely not a failsafe system.

While this is somewhat callous, if this engineer had taken that seriously he would still be alive.

[jacobush]

Or if Tesla had

[denkmoon]

Nobody at Tesla claims that this is a failsafe system. In fact, they specifically tell you to be ready to take over at any time. That is not a system I would rely upon, personally.

Are companies bound to only selling failsafe products? Of course not, we'd never get anything done.

I do find it somewhat immoral that Tesla are using their customers as beta testers for this, but nobody has been forced into this. Nobody is forced to use Autopilot.

[jacobush]

I think something about responsibility changes at scale.

If a Tesla was a bespoke machine, I'd have no issues. But they know that if they position a feature and posture just-so-and-so, a certain fraction of their customers will get it "the wrong way". What did they do to alleviate this?

Nothing, in my not so humble opinion.

[bagacrap]

In California every building has a sign affixed that warns of carcinogens within, does that mean you never go indoors? No, it means you learn to ignore safety warnings.

[xvector]

This is the real problem. Tesla had been aware of the "crashing into barriers" issue for a long time.