[lingrush4]

Every AI system is capable of generating CSAM and deep fakes if requested by a savvy user. The only thing this proves is that you can't upset the French government or they'll go on a fishing expedition through your office praying to find evidence of a crime.

[NewsaHackO]

>Every AI system is capable of generating CSAM and deep fakes if requested by a savvy user.

There is no way this is true, especially if the system is PaaS only. Additionally, the system should have a way to tell if someone is attempting to bypass their safety measures and act accordingly.

[Lalabadie]

> if requested by a savvy user

Grok brought that thought all the way to "... so let's not even try to prevent it."

The point is to show just how aware X were of the issue, and that they chose to repeatedly do nothing against Grok being used to create CSAM and probably other problematic and illegal imagery.

I can't really doubt they'll find plenty of evidence during discovery, it doesn't have to be physical things. The raid stops office activity immediately, and marks the point in time after which they can be accused of destroying evidence if they erase relevant information to hide internal comms.

[lingrush4]

Grok does try to prevent it. They even publicly publish their safety prompt. It clearly shows they have disallowed the system from assisting with queries that create child sexual abuse material.

The fact that users have found ways to hack around this is not evidence of X committing a crime.

https://github.com/xai-org/grok-prompts/blob/main/grok_4_saf...

[direwolf20]

Is there evidence this is the real prompt?

[robbru]

Grok makes it especially easy to do so.

[grunder_advice]

What makes Grok special compared to random "AI gf generator 9001" which is hosted specifically with the intent of generating NSFW content?

[plagiarist]

If AI GF Generator 9001 is producing unwilling deepfake pornography of real people, especially if of children, feel free to raid their offices as well.

[JumpCrisscross]

> What makes Grok special

X. xAI isn’t being raided. X is. If Instagram bought a girlfriend generator and built it into its app, it would face liability as well.

[tw04]

>Every AI system is capable of generating CSAM and deep fakes if requested by a savvy user. The only thing this proves is that you can't upset the French government or they'll go on a fishing expedition through your office praying to find evidence of a crime.

If every AI system can do this, and every AI system in incapable of preventing it, then I guess every AI system should be banned until they can figure it out.

Every banking app on the planet "is capable" of letting a complete stranger go into your account and transfer all your money to their account. Did we force banks to put restrictions in place to prevent that from happening, or did we throw our arms up and say: oh well the French Government just wants to pick on banks?

[MiiMe19]

Every artist is capable of drawing CSAM. Every 3D modeler can render CSAM. Ban all computers !!

[raincole]

Well every human can be an artist with some training. I guess the solution is to ban humans.

[tw04]

And the artist is punished for doing so. Thank you for proving my point.

[MiiMe19]

But we don't ban pencils do we?

[direwolf20]

right and X isn't having it's GPUs banned

[fourseventy]

You can use photoshop to create CSAM too, should that be banned?