Hacker News new | ask | show | jobs
by nonrandomstring 1004 days ago
> problem was the processes around the algorithm not its existence... > the problem is not the algorithm, its the investigators.

Indeed. Going deeper, the 'problem' is a social/cultural belief that doing X at scale, using a computer, is somehow more ethical than having a bunch of people do the same immoral thing. Computer automation and algorithms become a moral justification (or at least a Hail Mary) for immoral acts.

There is at once a diffusion of responsibility, a causal disconnection of consequential acts, a reassignment of responsibility, and - given that we bow down to machines as our masters rather than our tools - a change from choice to a belief in the "inevitability" of unstoppable processes.

Together these make us no longer question whether:

1) Computers are more reliable, consistent and accurate than people

2) Computers are fairer/just

3) Computers are more comprehensive/inclusive or selective/prejudicial

4) Computers are actually economically more effective

Of course, this has been going on since the 1960s at least and was part of "systems analysis for automation". I think we have regressed. Whereas it was commonplace to sceptically question technology in the 60s and 70s, today we start with the assumption that it must be "better" and then have to figure out how maybe it's not.

1 comments

The major difference is embarrassment. People don't like when other people see them in private, but they don't care if computers see them in private, so computerized surveillance is a lot more acceptable to people.
Good point. The benign neutrality supposition is a powerful factor I forgot. It was Weizenbaum who first wrote about this when noticing the relation between his secretary and the Eliza program.