[CSSer]

Geez that’s disturbing. I clicked having no qualms with nudes, artistic or otherwise. I’m not a prude. I’ve seen my fair share of anime girls and AI nudes. Hell, I was raised on the internet before parental settings were a thing, but I didn’t expect that. It’s so gross how it toes a line too.

[dingnuts]

the Fediverse has a big problem with this, too, and I never hear anyone talking seriously about it

[unshavedyak]

What is a serious talk, though? Ie what can be done? Isn't it a lot like the internet as a whole; report the offenders if you like then move on?

To me it's akin to encryption being used for illicit/illegal activities. Any tool that gives power to people can and will be abused by people you'd want nothing to do with.

What did you have in mind?

[tekknik]

probably when someone adds young, childish, and something sexual to the prompt it says no and alerts law enforcement?

[unshavedyak]

So is there some system that implements text/image classification for automatic law enforcement submission that you're referring to? Also jurisdiction, etcetc.

It all seems incredibly complex. Not a reason to "not try", but i suspect we'll struggle to implement even the most basic thing. And even then, take that basic thing and apply it to every software where users can input data.

Plus we'd have to convince everyone to do this. Automatic scanning and submission of data is not a well liked topic. Remember how Apple doing basic CSAM scanning was full of panic?

Even if a government _forced_ us to do this, jurisdiction alone would be a big question. Some serious questions that need some serious thought, imo. Is being hand-wavy even worth the time?

[tekknik]

you just need you search text, the prompt, for things normal people wouldn’t search for, not at all complex. nobody normal asks AI to create child pornography

[unshavedyak]

You picked the easiest (though still not easy imo) thing, and ignored the rest of the complexity haha.

If it's so easy i'd love to see your implementation that works multi-language, across all media types, for all jurisdictions and hell handles burden all the massive number of edge cases.

Or frankly, any implementation. Whatever you think is easy and everyone should be doing - please point to an E2E implementation of it. Maybe i misunderstand your scope. Something where if a user submits CSAM, or does something to some country authority..?

[GaggiX]

context: there are several instances that let you upload illustrations without a restriction on what content the image can contain, it can contain minors, rape, incest. These are instances are between if not the biggest and more active Maastodon instances. The reason why they are so active is because platform like Twitter while having a lot of these stuff too sometimes they will ban your account or at least shadowban you. Many Mastodon instances have banned these ones.

In my opinion instances should let the user decide what they find problematic or not and unless it's just spam they shouldn't ban instances.