[cudgy]

Humans are incredibly biased in making judgements like this. How do you “train” a person to enforce a standard that goes against their inherent biases?

Seems like the more objective the process can be shifted (by moving away from human decisions), the more effective/fair the process becomes.

Anyway, it sounds like you may work in this space, and, therefore, might have further insight, which I am very interested in hearing about.

It is definitely an Achilles Heel for social media platforms.

[wpietri]

Unfortunately, there is no real objectivity here. Machine learning systems are fed large numbers of human judgments, are tuned based on human judgment, and then are deployed when other humans think them ready.

The way you get reasonable consistency, whether it's humans or machines, is by establishing clear standards, using them for training, and then continuously monitoring results. It's not perfect, of course. But nothing is.