Hacker News new | ask | show | jobs
by pbhjpbhj 29 days ago
Models don't have to contain imagery of a thing to produce imagery of that thing - the canonical example is the pelican riding a bicycle.

Model makers, arguably, are like pencil manufacturers but in a World of good artists.

I think you can hold people to account for what they help to create, but not what they have potential to do.

Now, if models were trained on any csam, of course, the model's owners should be held you account.

2 comments

The vast majority of these offences are from apps or sites that generate and host the images themselves, often by openly promoting their ability to "nudify" people, and payment leaves them a paper trail. That makes them complicit. I agree that local/open source models are harder to police, but most grade schoolers are not going to be able to set up and run something like that.
And I think it would be an interesting question of discovery to determine if the models were or weren't trained on CSAM. (Diffusors were trained on both pelicans and bicycles, you know...)

I still think there's a lot of legal and IP landmines lying in wait from the Hoover-esque pre-training eras

Well, yes, models might be trained on naked adults and clothed children, incidental to their purpose.

Agreed on your second remark. If I'm still around it will be interesting to look back on this period on twenty years and think about how things should have been handled.