| It is difficult for a machine to be accountable for its decisions. It's not as simple as holding the manufacturer responsible, either. With human decision-makers, at least you have a bunch of douchebags that you can point your fingers at and attach epithets like "obtuse and unempathetic". And we can hope that if we collectively do something, we'll be able to replace them with less dysfunctional folks. With complex decision-making machines, it's not even clear whether a subtle bias it exhibits in its decisions is a sign of a bug or intentional design. The machine, of course, is capable of deep and broad analysis, but only of data that some group of engineers decided would be appropriate for it to analyze, using algorithms that were probably hand-tweaked by another group of engineers with their own individual quirks and unconscious biases. Even the idea that a machine can be "smart" or "flexible" is based on a particular definition of "smart" and "flexible" that other people might strongly disagree with. And yet the machine presents an image of perfect objectivity, and its complexity makes it nearly impossible for outsiders to figure out exactly who or what is responsible for the many assumptions that underlie its design. Moreover, the possibility of losing one's job is prettty much the only thing that keeps human decision-makers accountable in this world. Take that away, and we've got a benevolent dictator at best and a mechanical tyrant at worst, with the exact same quirks and biases, only hidden better. |