[logifail]

> You asked for the incentives for AI; the equivalent isn't the same as for humans. The nature of the AI doesn't include a concept of prison or licensing, so it can't be threatened with it [..]

There certainly should be incentives for the humans creating an AI, though.

> Don't anthropomorphise it, that's a category error.

Volkswagen [human!] engineers created the illegal defeat devices in Dieselgate, under the supervision of their [human!] managers. The device is illegal, we punish the humans in charge when laws are broken, not the devices themselves. It should be the same with AI.

If this means software engineering becomes a field where you need mandatory liability insurance to work on AI, is that a bad thing?

In the glorious words of Stelios Haji-Ioannou, "If you think safety is expensive, try [having] an accident"