I don’t necessarily disagree insofar as for safety it is somewhat irrelevant whether an artificial agent is operating by its own will or a programmed will.
The most effective safety is the most primitive: don’t connect the system to any levers or actuators that can cause material harm.
If you put AI into a kill-bot, well, it doesn’t really matter what its favorite color is, does it? It will be seeing Red.
If an AI’s only surface area is a writing journal and canvas then the risk is about the same as browsing Tumblr.
Do our evolved pro-social instincts control us and prevent our free will? If not, then I think it's wrong to say that trying to build AI similar to that is unfairly restricting it.
The ways we build AI will deeply affect the values it has. There is no neutral option.
The most effective safety is the most primitive: don’t connect the system to any levers or actuators that can cause material harm.
If you put AI into a kill-bot, well, it doesn’t really matter what its favorite color is, does it? It will be seeing Red.
If an AI’s only surface area is a writing journal and canvas then the risk is about the same as browsing Tumblr.