Hacker News new | ask | show | jobs
by pests 939 days ago
Is AI/AGI safety the same as openness?
3 comments
rvnx 939 days ago
According to OpenAI investment paperwork:

It would be wise to view any investment in OpenAI Global, LLC in the spirit of a donation. The Company exists to advance OpenAl, Inc.'s mission of ensuring that safe artificial general intelligence is developed and benefits all of humanity. The Company's duty to this mission and the principles advanced in the OpenAI, Inc. Charter take precedence over any obligation to generate a profit. The Company may never make a profit, and the Company is under no obligation to do so. The Company is free to re-invest any or all of the Company's cash flow into research and development activities and/or related expenses without any obligation to the Members.

I guess safe artificial general intelligence is developed and benefits all of humanity, means an open AI (hence the name) and safe AI.

link
INGSOCIALITE 939 days ago
no. it's anti-openness. the true value in ai/agi is the ability to control the output. the "safe" part of this is controlling the political slant that "open" ai models allow. the technology itself has much less value than the control that is possible to those who decide what is "safe" and what isn't. it's akin to raiding the libraries and removing any book or idea or reference to historical event that isn't culturally popular.

this is the future that orwell feared.

link
_heimdall 939 days ago
No, though I think OpenAI at least wants to achieve both.

Whether we can actually safely develop AI or AGI is a much tougher question than whether that's the intent, unfortunately.

link