[breuleux]

I think it's an important unanswered question whether intelligence really is the bottleneck for many of the things that require it. Is the production of better and better computer chips really bottlenecked by the intellect of the designers, or by simulation software and the back and forth between design and the physical process of prototyping and testing?

And if intelligence is not the bottleneck... well... is superintelligence actually worth as much as we think it is? Is human intellect the apex of what biological systems can do, or is it merely the point past which intelligence stops being the bottleneck and the returns of higher intelligence drop off dramatically?

[nvm0n1]

Yes, fully agree. There are a lot of unstated but unintuitive assumptions and intuitions going on in the AI risk/ethics community. It's useful to surface those.

[monkeyjoe]

I think this is a really interesting take.