It is, but… you’ve seen the marketing material being put out?
“AGI is just around the corner and could destroy humanity if we don’t solve alignment” is something AI leadership at multiple companies have publicly said.
Sure, but the same is true of nuclear reaction research.
One camp, using the same mechanism, is trying to make devices that end the world. One camp, using the same mechanism, is trying to save the world.
That nuclear/AI COULD end the world or COULD save humanity is exactly the reason that a truly neutral party would not describe either tech as a doomsday device but would instead describe either as technologies bearing massive potential.
No one building an LLM has ever publically stated that they aim to build a doomsday device and in fact have only ever specifically said that they are trying to avoid doing so. We've no reason to beleive that their interest is any different from any other corporation with agressive shareholders: increasing profits. Dooming humanity leads to lower profits. Lower profits is outside shareholder interest. They will do anything they can to maximize profit, just as any other profit driven org does.
No objective, neutral, observer would apply such loaded terms.
It's okay to have an opinion, but having an opinion makes you...opinionated. Not neutral. The opposite of neutral.
Your example kind of proves your position wrong, no? Nuclear power--another device you are yourself admitting is widely understood to be a doomsday device in the wrong hands--is also highly regulated and I cannot just create a company that sells a nuclear power device and I extra cannot do so and sell it to foreign nationals. If you make a device that you claim is capable of ending the world, you can and should be regulated.
“AGI is just around the corner and could destroy humanity if we don’t solve alignment” is something AI leadership at multiple companies have publicly said.