I mean, hackers aren’t such a problem that we ban developing new internet apps to only licensed professionals by executive order, so that kinda proves the parent posters point?
The difference is the scale at which a hacker can cause damage. A hacker can ruin a lot of stuff but is unlikely to kill a billion or two people if he succeeds at a hack.
With superintelligent AI you likely have to have every developed use and every end user get it right, air tight, every time, forever.
With superintelligent AI you likely have to have every developed use and every end user get it right, air tight, every time, forever.