Hacker News new | ask | show | jobs
by nwoli 753 days ago
Hopefully someone reverse engineers the model (unless this is a joke)
1 comments

It's not a joke unfortunately.

From: https://stratechery.com/2024/windows-returns/

"That latency, frustratingly enough, doesn’t come from the actual rendering, which happens locally on that beefy hardware, but rather the fact that Cocreator validates everything with the cloud for “safety”"

Why would MS bother to check something that's been created and stored locally?

Are they also uploading the files into the cloud to feed their AI/ML datasets?

If you use it to make CSAM locally, they would get hammered for allowing it to have happened
I can't wait for my Word documents to be uploaded to Microsoft to ensure I am not writing anything that is deemed to violate their content policy.
Photoshop isn't getting hammered even though it's been used for such things (CSAM, revenge porn, etc) for decades
Adobe Photoshop already checks for currency/money. And their AI extensions certainly check for “inappropriate” material. And there is a disclaimer on their cloud storage service that it can be searched.
Photoshop isn't created by Microsoft which has a completely different corporate ethos than Adobe. Whataboutism doesn't really work regardless of how it is attempted.
lol, nice deflection. MS Paint then. I can guarantee you it has happened.

Also what does "corporate ethos" have to do with "getting hammered"?

How would that even be known? Do Paint-exported JPEGs have a Microsoft watermark?
All it would take is a tweet that says someone used MS Paint to do something that the MS AI system allowed them to create, and the internet would go into fits.
MS stock wouldn’t crumble that day, PR dept would solve it in hours. The only reason they do that is “telemetry”.
Oh please. SD 1.5 has enough CSAM in it that I’m surprised that stability AI hasn’t been raided:

https://www.theverge.com/2023/12/20/24009418/generative-ai-i...

Weird since if image generation can run locally a simple classifier (eg clip) aught to be sufficient and run locally as well before presenting the image
I suspect they have humans reviewing those images and training AI in the process.
Only explanation that makes sense so far.
Other than training, there's CYA to ensure they aren't making inappropriate images of children or other things that might be deemed illegal
It seems like a whole bunch of unnecessarily liability. Once you place yourself in the position of moderator of what people may use their computers for, you are arguably liable for failures of moderation.

To put it another way, nobody's ever sued Canon for making cameras which are used to take illegal photos, but if Canon suddenly started screening your photos to make sure they were acceptable per local laws or whatnot, they suddenly are actually a responsible party in the creation and distribution of whatever it is people use their cameras for.

If they want that they could easily have a local classifier and only upload suspected images for review. The fact that they're willing to slow down the experience for everyone implies that they're doing training or something.
Oil paint manufacturers do not have to do that, why should a developer of a paint program have to do it?
Yeah that too. Sure plenty of tools could be used to retouch illegal pics and so on, but a court would probably see it differently if the model distributed by Microsoft is able to produce that on its own.

At the same time... F that, I don't want Microsoft nannying me.

That's kind of even worse, other people have no business at all looking at my private pictures.
Haha that's absolutely terrible.
lmao