| What's the appropriate level of liability? If I buy a cell phone holder for my car, and it distracts me and I get into an accident? What if Car Play lags and i'm distracted and I get into an accident? What if radio plays an ambulance and I freak out and get into an accident? What if my sunglasses make me mistake a red light? This product does lane assist. It does a good job according to consumer reports [0], higher than all other lane assists. It doesn't detect stop signs or traffic lights or drive for you. It keeps your lane. It acts predictably and gives the driver enough time to react. Unfortunately the liability model is messed up. I think this product is relatively tame and should allow to exist. And you need to pay attention. They even have inward facing cameras to make sure you're paying attention, more than most other companies. They do everything they can to be safe but of course they're not stupid and they'll put in a sweeping statement on liability. This is really pushing forward the self-driving industry and is an incredible feat of engineering. It's much more open and transparent than every other lane keeping software, and it's being developed with a lot of thought and care from a talented engineer as opposed to some nameless faceless bureaucratic commission in Ford or some other dinosaur. https://www.thedrive.com/news/37833/consumer-reports-ranks-t... |
My point has to do with what you're signalling. If a thing is alpha-level, and real humans can get killed, I wouldn't let random people buy it and use it in their cars, period.
Informed consent is deeply problematic for a product like this: Very few people have the expertise to look at the code and the hardware and properly evaluate the risks, right down to understanding which kinds of edge cases need to be very carefully avoided.
Unless you're vetting researchers and barring people who just want to save a few bucks and brag their car self-drives, you really don't know if every person who downloads the extra software really does grasp the implications of what they're consenting to.
You might grasp the implications, and so might many people in this thread, but that doesn't guarantee that everyone does. THE AUDIENCE OF HACKER NEWS IS NOT A REPRESENTATIVE SAMPLE OF SOCIETY.
And we are talking about a product to be used on open roads: In addition to informed consent from the person who downloads the software, if they get into an accident with another vehicle, pedestrian, or cyclist, did any of those people consent to share the road with someone who installed alpha software on their device?
Morally, I can't get behind a few disclaimers and a nudge-nudge, wink-wink for any kind of autonomous driving tech, even if it's "just" lane-keeping.
———
Update: But to be clear, I am in favour of people tinkering with all sorts of digital automotive tech, and we really should find a way for lone inventors or small teams to innovate without the "enterprise outfits" using regulatory capture to drown small competitors with red tape.
I'm only arguing in favour of truly informed consent, which I believe is tricky for driver assistance technology being provided to arbitrary customers.