Hacker News new | ask | show | jobs
by ericmcer 7 days ago
I don't think that is possible. Humans have always taken the path of least resistance, especially when it comes to work/school.

The idea that we just "trust everyone to carefully check and learn from AI output" as our barrier to human skillsets eroding is never going to work.

There is an Anthropic engineering post on HM front page that addresses this exact issue:

"... supervise the agent’s behavior via a human-in-the-loop. Claude Code previously protected against agents taking unintended actions by asking users for permission at each turn. Theoretically that works, but we’ve found the approach to be fallible. Our telemetry showed users approved roughly 93% of permission prompts. The more approvals a user sees, the less attention they pay to each, becoming over time much less diligent in their supervision. "

2 comments

https://en.wikipedia.org/wiki/Normalization_of_deviance

Yeah I'm seeing this with the attitude towards AI. Especially as the economic benefits increase, we will justify increasingly reckless approaches. (Probably until some major catastrophe. That seems to be how these things go.)

While it is human nature to minimize energy expended on doing things, progress has always come from the minority who prioritize disciplined thinking and action.

While minimizing energy spent worked well in historic periods where survival was hard, in this era of abundance and a complex, interconnected and fragile civilization, the same instinct becomes harmful.