[derefr]

> It would not surprise me to discover that the optimization that is best for the species as a whole and the optimization that makes me the happiest are two completely different things.

That is absolutely so--thus the need for a complex http://singinst.org/upload/CEV.html, rather than a simple one which just averages everyone's utility functions together.

[hallmark]

That was a pretty dense read, at least for me. I particularly liked two parts, though they may not add up to the meat of the paper:

1. "If you find a genie bottle that gives you three wishes, it's probably a good idea to seal the genie bottle in a locked safety box under your bed, unless the genie pays attention to your volition, not just your decision." Nice. Grown up version of some cartoon plots.

2. The description of spread, muddle, and distance. Very relevant to political theory.

If you are able to compose a tl;dr of the entire paper, that'd be awesome.