[godelski]

It's already being treated like nuclear and that's a problem

  - highly centralized
  - lots of misinformation
    - lots of fear mongerng
  - arms race between most powerful countries
    - who can't stop because if the other gets a significant lead it could be used to destroy the other
  - potentially world changing
    - potential to cause unprecedented levels of harm
    - potential to cause unprecedented levels of prosperity

Sometimes things are just done better with your enemy than in direct competition with them. "Keep your enemies closer" kinda thing.

As a parallel, look at medicine and gain of function research. It has a lot of benefits but can walk the line of bioweapons development. A mistake causes a global event. So its best to work together. Everyone benefits from any progress by anyone. Everyone is harmed by mistakes by any one actor. That's regardless of working together or not. But working together means you keep an eye on one another, helping prevent mistakes. Often ones that are small and subtle. The adversarial nature is (or can be) beneficial in this case

Regardless of who invents AGI, it affects the entire world.

Regardless of who invents AGI, you can't put the genie back on the bottle (or rather it's a great struggle to that's extremely costly, if even possible)

Regardless of who invents AGI, the other will have it in a matter of months