| I ran into something like this for an AI story generation site I run and despite not being easily horrified and generally bracing myself for misuse... I was horrified. In theory I'm in the "it's not real people" camp, but when you see users intentionally generating CSAM, even if it's all made up text, it's impossible to not feel like leaving them to their devices would be tantamount to enabling a pedophile. And I imagine it feels 100x worse the moment images get involved. - And an aside, but as a result of my experience running that site I personally look sideways at anyone I see being obsessive about local LLMs for roleplay. It seems like the people who would rail the most about privacy on the site (drilling me about the ToS, what can I see, etc.) were the people most likely to be doing this stuff. "If you have nothing to hide" is again, not a mentality I generally buy into, but it really played out here, and I think the people most obsessed with secrecy for their "adult use" of generative AI are currently a group of people you don't want to cater to if you can avoid it. |
I guess one could argue that having access to digital images could increase a pedophile's cravings. I don't know if there are any factual studies or data to confirm or refute this. It's often bandied about that one reason young people aren't having as much sex is because porn is so easily accessible. If true, it seems that would apply to pedophiles as well.