[burnished]

I reckon even beyond alignment our perspective is entirely molded around the decisions and actions necessary to survive.

Which is to say I agree, I think a likely path to creating something that we recognize as intelligent we will probably have to embody/simulate embodiment. You know, send the kids out to the farm for a summer so they can see how you were raised.

[TheOtherHobbes]

The core problem is we have no useful definition of "intelligence."

Much of the scholarship around this is shockingly poor and confuses embodied self-awareness, abstraction and classification, accelerated learning, model building, and a not very clearly defined set of skills and behaviours that all functional humans have and are partially instinctive and partially cultural.

There are also unstated expectations of technology ("fast, developing quickly, and always correct except when broken".)