[jhuni]

Our AI programs don't need to have their own preferences. Each rational agent can be assigned an assistant AI which will derive its preferences from the agent's already existent preferences.

[gojomo]

It'll be like everyone has an AI genie, granting them wishes!