Hacker News new | ask | show | jobs
by testplzignore 2940 days ago
> Don’t want to see autopilot disabled as a result of this, would rather Tesla use this to double down and apply new learnings.

I agree that Tesla obviously needs to be learning from this. But at this point in time, Autopilot needs to be turned off until Tesla can fix the fundamental flaws in the set of sensors on their cars. There is now strong evidence that Autopilot is dangerous, and there is still weak evidence that it is less dangerous than the alternative (i.e., a human driving).

I expect that the NTSB will eventually issue a safety recommendation that Autopilot not be used in its current form. I'm a bit surprised they didn't issue an urgent recommendation in the preliminary report, or even before.

1 comments

I have a hard time seeing it this way. Turned off until they can fix the fundamental flaws? Which flaws exactly? It’s a prototype technology that no one knows how to do perfectly. Should Waymo also be taken off the road? None of these technologies are provably safe, so we always have to accept some risk. How much risk is appropriate is hard to determine. Perhaps LIDAR would reduce the risk, but Uber showed you can kill people even on a LIDAR based vehicle if your software fails to classify the risk properly. And humans drive with just two eyeballs so it’s not unreasonable to think camera based systems should be in principle possible to make safe.

So we could pull all the self driving cars off the road, but then we inhibit their ability to collect the wide range of real world data necessary to build the technology. Or we could pull the less successful tech off the road sooner, but that would cause those programs to wither and hand the market to one or two well funded players.

I just don’t see how pulling the tech off the road because of a flaw that Tesla has likely already fixed would accomplish much.

I do struggle to understand what we should do, but I’m not so quick to think the tech should be pulled.