| > The problem is that no automatic method we have now will catch context. I disagree. The problem is that nobody is willing to be realistic about the limitations of automated moderation and proceed accordingly. If we can't create an automatic method that catches context, the solution isn't to bemoan that AI can't magically do what we want. The solution is to remove the rules that require AI to understand context in the first place, because it is fundamentally outside of our technical ability, and any attempt to achieve it will fail. The problem is people who think that context-based censorship is reasonable for a massive platform. It simply is not. It is reasonable at an individual level. It is reasonable at an interpersonal level. It's even reasonable at a small-group level, where specific individual human beings who are invested in the community can be aware of these context issues. It is not reasonable at Facebook scale, full stop. Facebook should not be in the business of deciding to ban things like this. That is a responsibility that belongs at a lower level. What does that look like in practice? If an individual posted it on their wall: * That individual uses their judgement and chooses to post it or not * The people who see it use their judgement and click the block button if they don't like it If an individual posted it in a small group: * The group can socially police such actions by commenting that they are upset by it * The group's administrators can privately reach out to the person who posted it, explain that they can't post such things in that group, explain why, and explain what actions they could take to remain in good graces * The group's administration can make a judgement call and remove the post, not on the basis of crude keyword detection, but on the basis of human understanding If an individual posted in a large group: * The large group can adopt clear and unambiguous rules that do not require context to administer, and enforce them accordingly on a case-by-case basis * The large group can pre-commit to not dealing with such issues, and require their members to deal with it privately, like human beings Trying to automate this process will always fail, and it will cause massive false-positive and false-negative issues as it does so. Engineers used to understand these concepts when I first entered industry 20 years ago. It's very disappointing to me that they either can't or won't now. |