[pj_mukh]

“ They should not only not cause incidents, they should also not make existing incidents far worse because of terrible decisions.”

Just FYI, it made this terrible decision because people were mad at cruise for stopping in the middle of the road to decide if it was safe to proceed. They were asked to change that behavior and pull over and they did, this time just dragging a human along.

So yes let’s set these absurdly high standards, while we leave children to fend for themselves against human drivers that have met non-existent standards on a continual basis.

But then let’s actually leave the autonomous cars on the road to test if they’re actually meeting them.

As you agreed, some statistic they figure out in a sterile or simulation environment doesn’t actually matter. Let’s put them back on the road..

[patrick451]

This is the problem with self driving cars. A human has the awareness to pull over when it's appropriate and also is able to recognize they just ran over somebody and it's best to stop completely. But AVs seem to just have a dumb if/else statement to control this behavior (yes, I know it is actually more complex than that, I work in this space. But that is how they behave).

Driving is infinitely complex. It's becoming increasingly clear that the current approach to AVs not up to the challenge.

[pj_mukh]

A humans awareness is not constant. It waxes and wanes, even more so with cellphones in hand.

The status quo is indefensible so setting up moving unknowable goal posts for something to replace them doesn’t make sense to me.

This particular problem can be easily solved by cameras in the under carriage to make sure there aren’t humans shoved in there by other bad drivers. I wouldn’t mind making that a requirement across the board and moving on to the next challenge the unpredictability of human drivers throws at a repeatable robotic system.

There is no evidence that there is a magical different approach that will work better.

[patrick451]

> A humans awareness is not constant. It waxes and wanes, even more so with cellphones in hand.

And even with supposedly* perfectly consistent awareness, the automation still failed catastrophically.

> The status quo is indefensible so setting up moving unknowable goal posts for something to replace them doesn’t make sense to me.

AVs are not better than the status quo, making them even less defensible. A human would not have drug that poor women for 20 feet because it was compelled to execute a pull-over maneuver. Even an OCD psychopath knows better.

* None of these things run actual realtime operating systems with fixed, predictable deadlines. Compute requirements can vary wildly depending on the circumstance. When compute spikes, consistency drops. A robot can only way approximate constant awareness by massively undersubcribing the compute budget.

[pj_mukh]

" A human would not have drug that poor women for 20 feet because "

Yea, it would probably be a lot more [1]. This is from...just last week. Its a pretty constant occurence. Its only in the paper of record because it happened in New York.

[1]: https://www.nytimes.com/2023/10/26/nyregion/nypd-tow-truck-b...

"Mr. Hayes said that after the collision, the child’s mother chased the tow truck down the street, screaming that the driver had killed her baby."

[pj_mukh]

"AVs are not better than the status quo"

We don't have the data to claim this, this confidently, and the only way to get the data is let the experiment keep running in the real world (only place that matters).

There will obviously with holes in the awareness (literal missing cameras under the car) that's what the testing is for. If someone says they can sit in a room, in a simulation environment and come up with all potential crazy things humans can do around autonomous cars, they are lying to you.

To me, its either this, or we pull all human drivers off the road, restructure our cities and put em on public transit (wholly support this).

I re-iterate: The status quo is unacceptable and indefensible. The human driver who actually caused the accident has still not been held to account (and probably never will be).

P.S: I accept your point about the system being non-realtime. Though I think there are some critical safety systems (LIDAR/RADAR cutoffs etc.) that might have a real-time response?

[oldgradstudent]

> We don't have the data to claim this, this confidently, and the only way to get the data is let the experiment keep running in the real world (only place that matters).

How about we start with something simpler: have Waymo, Cruise and their likes produce a rigorous safety case[1] arguing why their vehicles are safe.

Once the safety case is in the open, we can also evaluate how well their system satisfy the claims in the safety case, and if the assumption do not hold, we can stop the experiment.

They are experimenting on humans. The usual requirement is informed consent.

[1] https://en.wikipedia.org/wiki/Safety_case

[pj_mukh]

This is just..more paperwork, but sure, highly unlikely that these companies don't have this report built internally already. And like I said, there will be scenarios not covered by it, because we simply don't know what they are and can't think it up.

But if we're doing this, lets also make human Drivers do this, and for real parity, make sure all human drivers are kitted out with all the same cameras and logging systems we ask of from autonomous car companies, auto submitted to the DMV.

Then analyze all the reports on an annual basis to see if the human and/or autonomous agent should be allowed to continue to operate on the road.

I think people forget that driving is not a right but a privilege, I agree that both humans and autonomous agents should earn this privilege.

P.S: If the claim is that a one-time DMV driving test is enough, then that should be enough for autonomous cars as well (I'm not making that claim)

[patrick451]

> We don't have the data to claim this, this confidently, and the only way to get the data is let the experiment keep running in the real world (only place that matters).

I don't have to prove it. It's incumbent on the AV evangelists to prove they are better. I signed up to be a driver on roads with other humans. I have zero interest in being part of this experiment. Especially not when it comes out of silicon valley.

For an industry that claims to be all about safety and fixing how dangerous driving is, I expected them to be taking inspiration from Boeing and the commercial airlines. The remarkable, steadily improving safety record of the Airline industry should have been the paragon. Instead, they've copied the move-fast-and-break things playbook from the silicon valley tech bros. Which makes all of these claims hard to take seriously.

[pj_mukh]

I didn’t sign up to walk and bike with human drivers either (in fact I fight it daily) but here we are.

Cruise took 8 years before putting its truly driverless car on the road. “Move fast and break things” is a laughable idea here.

I will happily accept the safety record of flying, slowly achieved over a century of actually flying in the real world

[macintux]

> A human would not have drug that poor women for 20 feet because it was compelled to execute a pull-over maneuver.

I know someone who was drug for several feet by a human driver who didn't realize he was under her car. He was very fortunate to survive.

I'm skeptical about AVs, and this was definitely a bad look for them, but your response gives far too much credit to people.

[oldgradstudent]

> So yes let’s set these absurdly high standards, while we leave children to fend for themselves against human drivers that have met non-existent standards on a continual basis.

Looks like Cruise was well aware they are not even close to the average human driver when it comes to handling kids.

They didn't bother to tell us about that.

https://news.ycombinator.com/item?id=38170848