[Ironchefpython]

> I don't expect it will go that far at all. Surely a company will test the idea of having an AI give executive-level guidance, but when it does so, it will be hastily dismantled.

No, the AI won't be in charge. It won't set the overall goals. But it will be the truck drivers, the call center workers, the customer service specialists, the personal banking advisers.

When humans are told by the CEO of Wells Fargo, "you need to open 8 new banking accounts per day (because 8 rhymes with great) and we totally don't want you to cram unwanted products into existing customer portfolios, because that would be wrong wink-wink-nudge-nudge", most Wells Fargo employees are going understand what's being said (especially when they are disciplined for not acting illegally), and do the thing that their CEO tells them to do.

An AI given a fitness function to "open the maximum number of accounts, with a minimum probably of being caught performing illegal activity" is going to fuck over banking customers with a far more ruthless efficiency.