[smltr]

Actually, I mostly agree with you, except I disagree that consciousness is something only biological things posses so that any idea around it being a key part of AI would be an anthropocentrism.

I believe instead consciousness is the method of achieving this self design and self improvement that you have mentioned will be the basis of the technological singularity.

[1letterunixname]

AGI is the false presumption that we must re-make us completely with silicon and software, and that somehow, it will feel pain, have emotions, and will be viewed as a special being with the same rights as a human. It's a religious-adjacent fool's errand.