Great comment.
What's dangerous is that we'll be subject to the morality of those few people that are deciding what "alignment" or "bad behavior" means for an AI.
Is that not just society? I'm presently governed by a set of rules made up by a select elite group that no one ever seems to be happy with. No better alternative has won out over that.
Most viable opportunities are squandered because of apathy and failed systems-level cognition like this. Where someone wise knows a path, someone less-capable doesn't look for it, doesn't see it, then announces loudly "there is no way!".