[SideburnsOfDoom]

> It will be many small changes, that taken together will slowly transition towards full self driving cars.

The problem is that there is no smooth transition: there is a "valley of failure" in the middle of it, where there is enough automation that the human can disengage most of the time, but not good enough automation to avoid all errors, so the human operator has to step in to correct errors quickly, and doing do "cold" (i.e. from a disengaged state) is not good enough.

Dekker touches on this in "The Field Guide to Understanding 'Human Error'"

[2sk21]

Good point. I think it will get even worse as automation improves. Consider that problems beyond thew ability of the automated driving system are delegated to the human driver. As automation improves, the human driver will have to be even more alert to resume control.

[SideburnsOfDoom]

Yep, the sibling comment ( https://news.ycombinator.com/item?id=33370118 ) explains it well:

> humans are really bad at co-operating with machines. We are asked to pay full attention to everything around us and take over at a moment's notice, while doing nothing >99% of the time. Humans simply do not work like that.

I have been trying to find some refs.

here's a couple: https://www.skybrary.aero/articles/cockpit-automation-advant...

https://themobilityforum.net/2021/03/15/the-potential-pitfal...

Like most of the 'Human Error' research, it focuses on Aviation, but is worth a read anyway if you care about topics such as e.g. SRE and Incident response.