Hacker News new | ask | show | jobs
by mrguyorama 1110 days ago
>In many cases, Instagram has permitted users to search for terms that its own algorithms know may be associated with illegal material. In such cases, a pop-up screen for users warned that “These results may contain images of child sexual abuse,” and noted that production and consumption of such material causes “extreme harm” to children. The screen offered two options for users: “Get resources” and “See results anyway.” >In response to questions from the Journal, Instagram removed the option for users to view search results for terms likely to produce illegal images. The company declined to say why it had offered the option.

What in the actual Fuck

2 comments

I don't know what tags were in question but there are a lot of really-ambiguous terms out there, a lot of which get co-opted arbitrarily, so it's not outrageous to have allowed a click-through wherever doubt existed.

Minor examples: I tagged something saying only a #sissy would use it, but the only other content posted under that tag is feminization psyops porn.

#lolita should be explicitly outrageous, but it seems we use it to describe fashion style for both prepubescent children and the creepy adults who dress like them.

#FKK is some German acronym about nudism and families or something. I don't know if that's even allowed on Instagram but it comes up a lot on other platforms, usually adjacent to child porn.

The notorious Children of God cult used to deliberately conflate names of acts of sexual abuse with innocuous terms like "Bible study" so children reporting to outsiders would sound like idiots. "Please help, they make me do Bible study..."

This sort of induced confusion is how you get away with operating in plain sight.

Well this opens them to an adversarial attack with no recourse for users.