[Quarrelsome]

IF AGI is developed.

Lets not take is as a certainty. This problem might be beyond our capabilities. Its kinda like stating: When we invent warp-drive. We don't have a proof for warp-drives same as we don't have a proof for building AGI.

[pixl97]

>We don't have a proof for warp-drives same as we don't have a proof for building AGI.

We don't have a warp drive to copy, no idea how one could even exist, they are not in our known universe.

If we want to learn about an AGI, we just look in the mirror.

[Quarrelsome]

Fine. Show me the proof and we'll build it.

... except there is no proof. We have no proof but we talk about it like its a given. We talk about "intelligence" as if its an integer value that scales from 0 to infinity. These are ideas that we do not question enough.

I assert that its a possibility that we are incapable of building ourselves beyond reproduction.

[pixl97]

>I assert that its a possibility

Possibility means probability. So there is also the probability that we can build ASI, in which we should be very careful in our wanton abandon in attempting to create it.