Hacker News new | ask | show | jobs
by JazzXP 2766 days ago
Great write up. As a photographer, the more companies are relying on this the more frustrating the mis classification of SFW as NSFW is getting. I’ve copped a few Facebook bans from automated detection (I assume given how quickly the report comes in) for images totally within their community guidelines. A number of my photographer friends are in the same boat also. I counted at least 5 of us on 30 day bans in October alone.
2 comments

I had a friend pick up a presumably automated ban from Facebook this month for posting a picture of a soldier from a WWII re-enactment he went to. No gore, no nudity, just a half body shot of a German soldier in uniform standing in the camp, smiling at the camera. No idea what triggered it, but it is scary.
"WWII.. German soldier..."

"No idea what triggered it..."

Really? I don't agree with it, but it is almost certainly just "hey that's a nazi!"

In the past, Facebook's moderation (outside of user flagging) has involved some automated Facebook processes flagging the photo for review and then a human looking at the photo and decided to issue a account ban.

My friend lives in the mostly drama-free midwest, has a mostly drama-free facebook life, and participates in WWII reenactments seemingly a couple times a month. It seems very unlikely that this photo was flagged by a friend of his.

So it would appear that Facebook's automated tools are now sometimes thinking that WWII German soldiers are Nazi's. And either Facebook human thought the photo was worth a temp ban, or an automated tool is now banning anyone it thinks is a "Nazi". These are new things that haven't been happening in the past.

Ah, I didn't realize there were humans in the loop. Could also be that they are overworked and have just a few seconds to decide. Or a friend was being silly, or accidentally pushed the flag button.
Facebook uses human filters since their policy is not a simple "no nudity" one. For example, breastfeeding pictures are allowed.

https://www.wnycstudios.org/story/post-no-evil

I know that Facebook uses human content filters - A friend of a friend is one - but something has changed with Facebook moderation in the last few months, and I have a strong suspicion that Facebook has started rolling out algorithmic moderation without humans in the loop.
Given I've had (SFW) images reported within seconds of posting them to a private group, I think they've gone back on their word of that.