The code in the example isn't faulty. The goals are faulty in an non-obvious way, and drives the AI to optimize a solution to a fitness function in a way that humans might consider pathological behavior.
> to Comcast paving the future of the AI?
Comcast's goals are faulty in a non-obvious way. Comcast's goals are to maximize shareholder profit, and in doing so creates a culture of fraudulent billing and a horrifying gauntlet of a cancellation process that humans might consider pathological behavior. And AI is the next logical step to optimizing those corporate values.
I think the core point is that corporations are fairly general-purpose machines, designed to do things too "big" for individual people. (But smaller and easier to analyze than "civilization.")
Their hardware stack is different, but lessons about their computational structure and design pitfalls may be applicable.
The code in the example isn't faulty. The goals are faulty in an non-obvious way, and drives the AI to optimize a solution to a fitness function in a way that humans might consider pathological behavior.
> to Comcast paving the future of the AI?
Comcast's goals are faulty in a non-obvious way. Comcast's goals are to maximize shareholder profit, and in doing so creates a culture of fraudulent billing and a horrifying gauntlet of a cancellation process that humans might consider pathological behavior. And AI is the next logical step to optimizing those corporate values.