Hacker News new | ask | show | jobs
by TFYS 352 days ago
International co-operation to control development and usage. The decision to unleash AGI can only be made once. Making such a decision should not be done hastily, and definitely not for the reason of pursuing private profit. Such a decision needs input from all of humanity.
1 comments

> International co-operation to control development and usage.

Non-starter. Why would you trust your adversary to "stay within the lanes". The rational thing to do is to extend your lead as much as possible to be at the top of the pyramid. The arms race is on.

With these things, the distrust is a feature, not a flaw. The distrust ensures you are keeping a close eye on each other. The collaboration means you're also physically close and intellectually close. Secrets are still possible, but it's just harder to keep them because it's easier for things to slip
It's rational only if you don't consider the risks of an actual superhuman AGI. Geopolitical issues won't matter if such a thing is released without making sure it can be controlled. These competition based systems of ours will be the death of us. Nothing can be done in a wise manner when competiton forces our hand.