Hacker News new | ask | show | jobs
by TangoTrotFox 2865 days ago
You're not considering why the AI turns it over the human. It's rarely about some crazy imminent emergency where if the human doesn't respond instantly and with super-human reflexes, it's all over.

In reality it's mostly just the AI expected one thing, and observed another - so something's not working right and it seeks a disengagement. California requires companies to quantify disengagements and most go a step further and specify the reason for the disengagement. I think the reason for this is precisely because of your intuition -- thinking that disengagement means imminent danger. Even for companies with relatively large numbers of disengagements, there were generally 0 that involved any danger whatsoever.