[godelski]

While I think this is exactly what's happening, it demonstrates that we need more human in the loop interaction verifying the decisions of the machine learning algorithms. I don't think anyone that works in the space would disagree that this method would be highly susceptible to trolling. I mean look what happened to Tay[0]. You have to have some mechanism where humans are checking on how the system is learning.

The big question is: was this a recent effort to flag these phrases or was it a gradual thing? If it is the former, I think it is easy to forgive Google as things move fast. If it is the latter I think it brings questions about fundamental methodologies.

I am being intentionally ambiguous about what is being classified because there are similar complaints about other subjects so I want to generalize.

[0] https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...