Hacker News new | ask | show | jobs
by SoftTalker 632 days ago
> trusting it implicitly because it is usually working

I think this danger is understated. Humans are really prone to developing expectations based on past observations and then not thinking very critically about or paying attention to those things once those expectations are established. This is why "self driving" cars that work most of the time but demand that the driver remain attentive and prepared to take over are such a bad idea.