[Planktonne]

No one assumes that AI systems won't be improved upon. What people don't assume is that progress will be infinite in every domain cheaply forever.

[aaroninsf]

People don't make this assumption, if you ask (or reflect);

arguments however regularly are implicitly predicated on exactly this premise.

(Infinite improvement, no; enough improvement that practically speaking the difference between effectively free and free is meaningless—that may well be the ultimate bitter lesson.)