Hacker News new | ask | show | jobs
by DeathArrow 1177 days ago
If we are already going down to that point, why not let AI fly commercial aircraft or drive nuclear power plants? What is the worst that can happen?

IMO at this level that we reached AI does a lot of stupid things. I guess it will never be perfect and it's wrong to let it be in charge of high stakes domain. Use it for helping humans, yes, it can be a great tool. Let it take decisions? No, unless you are suicidal.

4 comments

calm down, it's setting up a minecraft server
from there it's a slippery slope to becoming a darknet drug lord and overthrowing the government of the Maldives and it happened before.
You set the goal to whatever you want.
On particular days the absurdity of our existence lets me to believe the creators of our simulation are busy laughing.

"Oh, look at this, those monkeys that crawled out of the trees a few epicycles ago have created metal that thinks and are plugging it into their global communications network. Who wants to make a bet their extinct in the next 3 millicycles."

My company builds AI systems for Nuclear plants. In fact, AI systems based on LLMs are already handling issue triage at several plants in the US. Dynamic Operating procedures are something the industry is interested in and in certain scenarios can add significant safety margin. In these scenarios, there is no documented procedure action for the operating crew to follow and they are under high stress/cognitive load.
>why not let AI fly commercial aircraft

Most commercial aircraft are already capable of taking off, flying, and landing, completely under computer control.

Computer control =/= AI. AFAIK, no certified aircraft has a model-based stochastic blackbox at the yoke.
Judging by the mere flood of praise of AI on HN, where we know people are over average smart, I truly am concerned.
Can we fix shopping lists first?