[prestadige]

Every tyranny is predicated on saving civilization.

Also, every idea that actually helps civilisation is incubated in a tiny minority (perhaps in just one mind). Since that minority is engaged in creative work, it is almost certainly an out-group. Adopting the morality of the ruling class and building connections with it are the surest way to power. But these are a full-time job.

I think the idea of quantifying morality might be improved by basing it not on cooperation but simply upon communication, e.g. how well do you know the opinions of those you disagree with? Note that this is almost the opposite approach of the path to power.

[sage_joch]

I don't think "tyranny of the majority" applies here. The proposed system makes minority opinions more visible, if anything. There would even be an incentive to have a minority opinion, if you truly believed the majority was incorrect about something. In response to your last point: that sounds like an interesting modification: letting every bot see every other bot's (possibly evolving) code. But perhaps to avoid Skynet, bots should use the other bots' published APIs (which could opt to include a "getCode" method), and judge each other by their actions.