[salawat]

...Are you trying to create a mentally unstable, compute amplified, humanity trained, engagement optimized, potentially omnicidal self modifying/evolving computer program?

Because that's gonna get you one. Don't open the damn box. For all of our sake.

[LangIsAllWeNeed]

Person asking floaty questions is not likely holding the box.

I kind of think the current cpu design is not sufficient for the timely creation of any motivationally complex self organizing agent.

or perhaps just any non organic structure can’t capture certain things we seek to model.

But perhaps it does not preclude the creation of a better mimicry of human attributes with narrow reward model. LLMs seem to demonstrate this is possible.

However maybe we need to risk seeking an overman. We are sitting on enough nuclear weaponry to destroy modern civilization forever and we are fundamentally unstable beings.