Thank you for writing this up and delivering this very reasonable argument against AI Armageddon fears.
I do think your conclusion can be a little stronger. Because the process of making AI is so distributed, and the many layers of the stack which are not isolatable, an AI improving itself is going to be a gradual process. The discontinuous jump worried about is not physically realizable.
I do think your conclusion can be a little stronger. Because the process of making AI is so distributed, and the many layers of the stack which are not isolatable, an AI improving itself is going to be a gradual process. The discontinuous jump worried about is not physically realizable.