Hacker News new | ask | show | jobs
by orange_tee 1995 days ago
Describing driving assist as "beta FSD" is already grossly misleading, and still my point stands, either they were mislead or they were suicidal.
1 comments

I was highly skeptical of these systems too: for normal freeway driving, Tesla’s systems are much better than I expected them to be. There’s no way I would be comfortable enough to sleep in my car, as a programmer, but I could imagine someone getting overconfident. This has always been a major risk with semi-automated systems: I believe airplanes dialed back the functionality of autopilots to prevent pilot complacency.
OK that is a good point. So you are saying, maybe the marketing wasn't what misled the driver, but the abilities of the system. A system that fails 1% of the time will give a the user overconfidence up until the first time it fails.
Yeah, this is a good way to put it.
>airplanes dialed back the functionality of autopilots to prevent pilot complacency.

Or maybe because the potential for disaster is too great, like the 737 max attempting to nosedive into the ocean because of a single sensor failure.

This is a well-known issue: when automation gets good enough that the human in the loop starts to get bored, it can be more dangerous than either “all human” or “all computer”
Automated flying reminded me of this incident in India - some pilots used to cover the windows of their cockpit with newspapers after take off, presumably to have a short nap!

Source: https://www.nytimes.com/2011/05/26/business/global/26airindi...