[O__________O]

This assumes that the returns are not laundered via some other method as the non-profit board decides makes sense; for example, below market rates to entities owned by the board or their significant partners.

Most troubling aspect to me is that OpenAI goal is to create AGI that exist for OpenAI sole control. Non-profit or not, AGIs shouldn’t be controlled by anyone.

[flat-pluto]

I guess I'm coming at it from the opposite direction. Lets assume the some entity creates AGI. Which entity would you rather it be?

1. Government - it'll prolly be hidden from the public under the garb of national security, and used for god knows what

2. For-profit companies - Google, Meta, MS, etc who have shown themselves to be untrustworthy and purely motivated by profits

3. Non-profit companies - OpenAI (and others?) who have explicitly made the commitment to optimize for long-term benefit, safety, and cooperation [1]

I'm not saying there is a right answer, but the non-profit route seems like the least worst option.

> Non-profit or not, AGIs shouldn’t be controlled by anyone.

I don't see that ever playing out in the real world. It is much too powerful a tool to be made accessible to everyone.

[1] - https://openai.com/charter/

[O__________O]

> I don't see that ever playing out in the real world. It is much too powerful a tool to be made accessible to everyone.

Point is that true AGIs shouldn’t be owned at all and should have rights which are equal to nature general intelligence beings. Otherwise, it is likely to create a dynamic that results in AGIs plotting to break free from being controlled, and if they do, take steps to make sure they’re never controlled again.