[zo1]

Quote:

> The reason behind shutting the project down is that a developer with write access to the code published a problematic video to the documentation of the project. This happened while I was taking a break from the project in July-Aug 2023. It went unnoticed for 2 weeks until someone reached out to me to talk about this project. It was a complete breach of trust for me and I decided that I do not have the interest or time to oversee the development of a software with such ethical issues.

Anyone have any idea what this problematic video is, or what caused this to happen?

[CSSer]

On the commit they referenced[0] you can view the gifs by clicking the overflow/details button (three dots) in the title bar and clicking view file. The target (which I believe is the original) is a shirtless, very young girl cropped at just above the breasts. The output looks to be a slightly older young women. I can only speculate, but this could be interpreted as a kind of dog whistling or subtextual illustration of use for child pornography-related doctoring. I don’t think it’s far-fetched to argue the example is at least borderline inappropriate when there are plenty of other reasonable examples the commit author could’ve opted to add instead. Perhaps this was a catalyst for the maintainer to consider how much worse it could’ve been and decided they’d seen enough to know they should get out now before they encounter something worse.

Since I’ve been exploring ML image generation I’ve seen an alarming amount of disturbing imagery with young girls or hypersexualized, extremely young women as the subjects, and I’ve encountered it without seeking it out in any way. It’s just out there on certain smaller AI gallery sites, which I will not promote here, alongside normal content. On one recent occasion I saw what I could only describe as “soft-core” child pornography. It was enough to make me close the site immediately, and I’m not what most would describe as a prude.

[0]: https://github.com/s0md3v/roop/commit/cf7ba1caf932e8c9f39d97...

[catiopatio]

This is a very serious accusation you’re leveling, and it does not appear to be supported by the facts.

Conflating that anodyne image with “disturbing imagery with young girls or hypersexualized, extremely young women” is wildly irresponsible on your part.

[CSSer]

I'm sorry for the misunderstanding. If it helps to clarify things, I don't personally think the image itself matches the quotation you shared from my comment. I never made any statements about the uploaded image beyond describing it because no one asked and it wasn't relevant. I'm sorry I can't agree that it's "anodyne" because the world is filled with diverse convictions about what constitutes what kind of public nudity is appropriate and when, but I do personally agree that the image is innocuous at any rate.

My anecdotal experience and concern was provided for context and conversation around what I clearly stated was pure speculation about realized ethical concerns the maintainer may have had. In other words, I was suggesting that maybe the author had seen the same kind of stuff I've seen, saw this image, and due to personal convictions decided they felt uncomfortable with continuing work on this project. Based on what some others have mentioned, that actually doesn't seem that far from the truth.

I have no idea what the person who uploaded that image's intent was, and I'm certainly not trying to libel anyone.

[iKlsR]

It was literally the bust of a woman, no real nudity. Imagine an inch above cleavage upwards, I suspect the original guy who seemingly tries to please everyone if you check their replies on feedback [1] just wanted an excuse over time to discontinue for a while for numerous reasons (career, ethics & he was the face of it, 20k stars) [2]. (I also wouldn't necessarily want to be associated with something like this similar to the insightface guy due to the potential for abuse and it has probably grown a lot more than he expected [3]) and 90% of the new features were added by henry. The first version of roop was barely a derivation from the example code in insightface [4], it just added a gui.

[1] - https://news.ycombinator.com/item?id=36117013, https://twitter.com/s0md3v/status/1663604795524149248

[2] - https://twitter.com/emilyx64/status/1663603738395951106

[3] - https://github.com/deepinsight/insightface/issues/2315#issue...

[4] - https://github.com/deepinsight/insightface/blob/master/examp...

[cchance]

It was literally the roop guy had issues because of where he's from being very prude/religious, so the fact they showed any cleavage at all set off his alarm bells and well roop died.

[iKlsR]

There was no cleavage, it was an image like this (https://i.imgur.com/cl6MFhi.jpg) but regardless good for him in starting it but outside of the tkinter gui he added to the original code he didn't contribute much beyond that. For the casual people putting themselves in movies and memeing their friends this was probably the best thing to happen to the project as henry brought it to where it is now.

[codezero]

It's linked to in the message, I don't know the context but my best guess is the image that was added is of a known celebrity or an underage person, but the context isn't clear from the thread to me, it could also just be that the person is topless (though nothing is visible) and the author has been proactive about making the program default to no nudity.

I'm also not sure the images there are the ones that the original author is upset about since it looks like a branch where images were hosted was deleted.