Hacker News new | ask | show | jobs
by Magi604 977 days ago
>When you use Paint Cocreator, we apply content filtering and have other safeguards in place to prevent the generation of images that may be harmful, offensive, or inappropriate, and we are continuing to optimize how Paint Cocreator works based on real-world usage and feedback.

If it's anything like their current Dall-E 3 filtering, the only things you will be able to generate without triggering any warnings or filters are inert landscapes

4 comments

The puritanical snowflake nanny state needs to die.
This is not the nanny state, it's just PR concerns. They don't want to be associated with headlines like "FBI Finds Child Porn Images Generated by Microsoft's AI".
PR concerns about what puritans will think. Puritans love a nanny state with the entire modicum of affection their shrivelled black hearts can muster.

No, I'm not defending CSAM or AI simulacra of it. Fusing the medium with the censor is an abomination. It's Cocreator wagging the finger today, tomorrow it's Clippy popping up to tell me that what it thinks I might be making is too objectional for me to continue making it.

> PR concerns about what puritans will think.

Not because they are afraid of regulation, but because they want to lobby for anti-competitive regulations using "safety" as the premise.

"It looks like you're writing a threatening letter! :) " - clippy, probably
The difference probably is the hardware it runs on.

It feels like the same argument about hosting files: if you provide a service then you're responsible for what happens in it.

There's plenty of self hosted image generators without any guardrails whatsoever if you're so inclined. Browse around https://civitai.com/ for a bit you'll quickly see the implications

Please tell my why this prompt is blocked by Bing's image creator then: "view from inside a shark's mouth as it hunts fish" but "view from inside a shark's mouth as it looks for fish" is fine.

A shark hunting is over the line but it can look for fish fine?

What’s the state got to do with it? This is all markets.
It’s funny how most of us have never run into a single case of these AI tools censoring us, and others seem to get constantly censored for doing nothing wrong.
n=1 but I find I'm consistently censored trying to generate images of people, but drawings, animals and objects are generally fine so perhaps that's the difference.

Try "a super hero asleep on the couch, under a blanket" in dalle-3 and see what you get, I get zilch no matter how many times I run it, this is clearly unsafe content apparently.

I've found the AI generally more forgiving on anything "art". This lets you get away with things like a nip slip on a statue or provocative situations in a painting for instance. The second you try and make it in a "realistic" setting though, you get the dog or worse.
Strange, that query worked fine for me on dalle-3.
Do they mention anywhere what DALL-E version is being used? I have a suspicion it's not DALL-E 3 but happy to be proven wrong.
Everything may be harmful, offensive or inappropriate to someone...