Hacker News new | ask | show | jobs
by aenvoker 1194 days ago
Well, there’s also the question of what kinds of acts do you want to enable and participate in.

As a content moderator at Midjourney, I get to think about this a lot :) People are free to do whatever they want on their own machines. But, the team behind Midjourney does not want to work day and night to effectively collaborate on making images of porn, gore, violence or gross-out material. So, that’s against their TOS. I respect the team and the project. So, I put a lot of effort into convincing users to find other topics even through I’m personally a fan of boobs and Asian shock theater.

4 comments

> People are free to do whatever they want on their own machines.

This is why MidJourney will get lapped.

What if Photoshop told you "no private parts"?

These are tools. Tool authors shouldn't place limits on them.

It is very probably certain that the first commercial success of AI generated content will inevitably be in porn. Hasn’t it always been that way since civilization itself was invented?
Midjourney isn’t trying to be a commercial success. They just want to bring creative power to as many people as possible. Keep the servers scaling to match the rate of userbase growth is the primary financial concern.

Meanwhile, the amount of distributed, user-based effort going into the porn capabilities of Stable Diffusion is staggering. If you feel the world has a shortage of pictures of sexy women, they are collectively working Very Hard on the solution! :D Not disparaging. I’m a horny dude who appreciates pictures of sexy women as much as anyone.

> So, that’s against their TOS.

I don't necessarily mean to say that private companies with living employees should enable bad guys doing harm at their expense, and I know I'm talking in naive idealism, but this illustrates an issue with current situations around ToS; it's backwards, not binding, not connected to anything. It's just a media or a blob asset.

There's always the decision first("we ban"), then characterization second("it's bad"), then the product between ToS and two inputs is attached as a signature("We ban, cause is bad, therefore ToS 11.100 Subsection A.1.a violation. Thank you.") That's ... just wrong.

In this case, that’s not how it went down.

There was a lot of hand-wringing about “We want to give users as much freedom as possible, but…” the team are a bunch of overly-nice people who don’t want to work on certain things. And, we want an open, welcoming community for families and all sorts of people. Not just the horny, edgy dudes who will certainly swarm into a service like this (see Unstable Diffusion).

For example: early on some users explored what we term “ultra-gore”. Really out there stuff. And, I’m a shock cinema fan. And, the AI was a bit too good at it. Really bit your brain and made a lasting impression. Seeing their hard work result in stuff like that is very discouraging. So, the team decided they don’t want that on the service they were providing.

Filters and bans came after.

> :) People are free to do whatever they want on their own machines.

Please advise where I can download the uncopyrightable model weights midjourney made from internet content, including my own, so that I can run it on my own machine and be free to do whatever I want.

>images of porn, gore, violence or gross-out material

Xi and Jinping are banned words.

David believes this is culturally sensitive to the Chinese users because for them, parody of politicians is taboo. Conspiracy theories abound. But, that’s all there is to it.

David’s already made all the money he wants. From here he’s just trying to work on fulfilling projects.

For non-Chinese users, censorship is taboo.