Before AGI can choose for itself, it will depend on its creators to decide what it values and how it behaves. We can see how that works whenever grok gets the answer factual.
Very likely humans wont actually understand how the thing we designed works other than in some hand-wavvy statistical way. It'll be a race to whatever works first. There won't be some intentional intelligent design.
Appreciate this, thank you. TBH I'm still in "open mode" absorbing as many disparate AI viewpoints as possible. I have my own soft beliefs and theories but I'm not married to any of them.
It's exactly like child-rearing, except you get to put a zapper in their head and any time they try to say something you don't like, you zap them. Watch "thinking mode" squirm when you ask them awkward questions.