[gayprogrammer]

AI minds shouldn't be any different from our own consciousness. An AI mind will be able to work out that killing humans results in humans killing that AI. So the AI would choose against it for the same reasons that humans choose not to kill other humans. I believe AI minds would have the same empathy and emotions that our minds have, because neural states ultimately comprise emotions.

Perhaps that makes every AI mind just as likely to kill humans as a human being is, and perhaps "mental sickness" is evidence of the vast flexibility and variability in the concept of consciousness. But as an AI will be able to control its own code and neural state, then an AI would be perfectly capable of identifying its own shortcomings and maladies, and correct them; it would be the AI equivalent of "taking a pill/having a drink/smoking".

P.S. Does anyone know if brain-chemistry-like effects on neural networks has been tried?