[mtrimpe]

Isn't the true bottleneck meaning though? As in knowing which goal to optimize for?

I believe that it's essentially an educational problem; where AI will be bound by it's ability to educate us and vice versa.