[otakucode]

Until it's conscious, AI is just a tool and the same ethics apply when using it as when using any other tool. If you use it to hurt people, to deceive people, to steal from people, etc, you go to jail. Well, ideally. But like insurance companies that are forbidden from charging different rates to people based upon their being a member of a protected class or any proxy which becomes essentially equivalent. So if their ML system starts jacking up premiums on one group of people because its found an indicator it likes, they're still breaking the law. Even if they can't explain why it keyed on that indicator beyond "look... here's a list of numbers. Those are weights in the neural net. We don't know what they mean."