Hacker News new | ask | show | jobs
by hyperbole 2992 days ago
I don't buy this either nor should we it's not how the feature is marketed.

"The system is designed to be able to conduct short and long distance trips with no action required by the person in the driver’s seat."

The result of this statement and the functionality that matches it is it creates a re-enforced false sense of security.

Does it matter whether the driver of the model X whose auto pilot drove straight into a center divider had his hands on the wheel if the outcome of applying autopilot is drivers focus less on the road? What is the point of two drivers one machine one human? You cannot compare car auto pilot to airplane they're not even in the same league. How often does a center divider just pop up at 20k ft?

Usually machinery either augments human capabilities by enhancing them, or entirely replaces them. This union caused by both driver and car piloting the vehicle has no point especially when it's imperfect.

I'm not opposed to Tesla's sale of such functionality, sell whatever you want, but I am opposed to the marketing material selling this in a way that contradicts the legal language required to protect Tesla...

There's risks in everything you do, but don't market a car as having the hardware to do 2x your customers driving capability and then have your legal material say: * btw don't take your hands off the steering wheel... especially when there's a several minute video showing exactly that.

Tesla customers must have the ability to make informed choices in the risks they take.

4 comments

Which is, by the way, part of why I love the marketing for Mobileye (at least in Israel, haven't seen e.g. American ads). It's marketed not as driving the car, but as stepping in when the human misses something. Including one adorable TV spot starring an argumentative couple who used to argue about who's a better driver, and now uses the frequency of Mobileye interventions as a scoring system. Kind of like autonomous car disengagement numbers :-P
There is a solution for this - if the driver shows any type of pattern of not using the feature safely, disable the feature. Autopilot and comparable functionality from other vehicles should be considered privileges that can be revoked.
Systems that are semi autonomous where there's some expectation of intervention work well in those scenarios, keep the car in lane markers on the highway, etc. Make sure the users hands are on the wheel but for fully autonomous even if your hands are on the wheel, how does it know your paying attention?
Just turn off autopilot if no human input is detected. Hands on the wheel may not be enough input but some other combination may be enough.
maybe don’t call it autopilot then. call it “driver assistance”?.. or something that doesn’t make it sound like “autopilot”.
On the other hand that is exactly what autopilot means...
This is exactly what the Tesla does. It periodically "checks" that you are there by prompting you to hold the steering wheel (requiring a firm grip, not just hands on the wheel). If you don't, the car slows to a stop and disables autopilot for the remainder of the drive.
You’re quoting the marketing copy of Telsa’s unreleased full selling driving capability.

Tesla have sold people that the hardware they buy now will be capable of this in the future, but not now.

> I'm not opposed to Tesla's sale of such functionality, sell whatever you want, but I am opposed to the marketing material selling this in a way that contradicts the legal language required to protect Tesla...

First let me state that I agree with this 110%!

I'm not sure if this is what you are getting at but I'm seeing a difference between the engineers exact definition of what the system is, what it does, and how it can be properly marketed to convey that in the most accurate way. I'm also seeing the marketing team saying whatever they can, within their legal limits (I imagine), in order to attract potential customers to this state-of-the-art system and technology within an already state-of-the-art automobile.

If we are both at the same time taking these two statements verbatim than which one wins out:

> Autopilot is not a fully-autonomous driving system. It's a tool to help attentive drivers avoid accidents that might have otherwise occurred. Just as with autopilots in aviation, while the tool does reduce workload, it's critical to always stay attentive. The car cannot drive itself. It can help, but you have to do your job.

and

> The system is designed to be able to conduct short and long distance trips with no action required by the person in the driver’s seat.

If that's the crux of the issue that goes to court then who wins? The engineering, legal, marketing department, or do they all lose because the continuous system warnings that Autopilot requires attentive driving were ignored and a person who already knew and complained of the limits of that system decided to forego all qualms about it and fully trust in it this time around?

I feel like when I was first reading and discussing this topic I was way more in tune with the human aspect of the situation and story. I still feel a little peeved at myself for starting to evolve the way I'm thinking about this ordeal in a less human and more practical way.

If we allow innovation to be distinguished for reasons such as these will we ever see major growth in new technology sectors? That might be a little overblown but does the fact that Tesla's additions to safety and standards thus having a markedly lower accident and auto death rate mean nothing in context?

If Tesla is doing a generally good job and bringing up the averages on all sorts of safety standards while sprinting headlong towards even more marked improvements are we suddenly supposed to forget everything we know about automobiles and auto accidents / deaths while examining individual cases?

Each human life is important. This man's death was not needed and I'm sure nobody at Tesla, or anywhere for that matter, is anything besides torn up about having some hand in it. While profit is definitely a motive I think the means to get to the profit they seek Tesla knows they have to create a superior product and that includes superior features and superior safety standards. If Tesla is meeting and beating most of those goals and we have a situation such as this why do I feel (and I could be way wrong here) that Tesla is being examined as if they are an auto manufacturer with a history of lemons, deadly flipped car accidents, persistent problems, irate customers, or anything of the like in this situation?

For whatever reason it kind of reminds me of criminal vs. civil court cases. Criminal it's upon the State or Prosecution to prove their case. In the civil case the burden is on the Defense to prove their innocence. For some reason I feel like Tesla is in a criminal case but having to act like it's a civil case where if they don't prove themselves they will lose out big.

To me it feels like the proof is there. The data is there. The facts are known. The fact that every Tesla driver using Autopilot in that precise location doesn't suffer the same fate points toward something else going on but the driver's actions also don't seem to match up with what is known about him and the story being presented on the other side. It's really a hairy situation and I feel like it warrants all sorts of tip toeing around but I also have the feeling that allowing that "feeling" aspect to dictate the arguments for either side of this case are just working backwards.

And for what it's worth I don't own a Tesla, I've never thought about purchasing one. I like the idea, my brother's friend has one and it's neat to zoom around in but I'm just trying to look at this objectively from all sides without pissing too many people off. Sorry if I did that to you, it wasn't my intent.

No one wins when someone dies... I'm sure your right that Tesla employees are torn up.

My concern is that it looks like Tesla is 90% of the way there to full autonomy and the way the feature is marketing will lull even engineers who know more about how these systems work into a false sense of security and end up dying as a result -- they'll trust a system that shouldn't be trusted. There isn't a good system for detecting a lack of focus especially when it won't take more than a few milliseconds to go from good to tragic.