[naasking]

> That makes an assumption that there aren't limits on intelligence regimes and that you can just recursively improve intelligence without much friction.

No it doesn't. AI just needs to get smarter than humans for it to be dangerous to us. The costs C and C' the parent comment described can include an upper bound on the cost of the self-improvement needed to achieve each respective goal.

[colordrops]

I don't disagree with you seem to have missed the hypothetical situation I was responding to:

> It can’t, so it spends some time recursively improving itself

[naasking]

I was responding to your response to that. Recursive improvement doesn't need to be unbounded, it just needs to supercede us.