Hacker News new | ask | show | jobs
by hgoel 19 hours ago
>child pornographer(grok)

People call grok that because deviants were abusing grok's ability to edit images and post them publicly on X to strip people - including children - of their clothes, from their public photos. Then when there was backlash, Elon laughed it off. It took half the world opening investigations against X for violations of existing regulations for action to be taken.

The leniency that internet companies get in terms of dealing with illegal content comes with the expectation that they're making reasonable efforts to control the distribution of said content. X, and Grok, were actively supporting the production and distribution of the content in public.

It is very different from someone creating such images in a private account, and definitely very different from someone using a local model to do it.

1 comments

My entire post was how it is unreasonable to have a dual standard, and my point was it's really irrelevant if it's a model you download and use locally, or if it's a model hosted remotely, or hosted and created remotely. You're not really providing any sensible reason where the line is, except "public company", which is, again, the entire point I'm making.

The only realistic, non-double standard is that the creator of the model should be 100% responsible. What on earth does it have to do with who's hosting it?

And by this metric, aren't all the uncensored models on huggingface, child pornographers? And if so, why not? Provide tangible, real, sensible reasons please, and after all, isn't hugging face a company?

You know, people are all over the place on this. I see people complaining about guardrails, then in the next breath complaining there aren't enough. Complaining that open models are the thing, but then creating double standards.

So once again, what is your actual reason why it's different?

It isn't about "public company", the line is "posted to a public social media platform, with the owner indicating amusement".

If someone uses something one of OpenAI's hosted models to generate illegal content, it isn't automatically spread to anyone that clicks on the post the original image is from. On top of that, OpenAI does not explicitly endorse the use of their models for such activities the way Musk did.

If someone uses a local model to generate illegal content, same thing applies.

I have a hard time believing that you're arguing in good faith. The differences are so blatantly obvious and they don't even require any discussion about guardrails. Grok was being used to edit images and post them on public social media. The technology to edit images has existed for decades now. So here's a direct analogy via Photoshop:

1. In the case of a local model: Someone using a local image editor to edit photos into illicit material and manually distributing them.

2. In the case of a hosted model: Someone using a cloud image editor to edit photos into illicit material and manually distributing them.

3. In the case of Grok: Someone using a cloud image editor to edit photos into illicit material, the cloud image editor automatically distributing it to the public, and the owner of the editor endorsing the material as an exemplar of what their editor is capable of.

In 1 and 2, the editor (ie the AI) was just a neutral tool. In 3 the issue is that the company explicitly endorsed and distributed the material, no longer neutral. This is why it's reputation is of being a CP machine.

The leniency that internet companies get in terms of dealing with illegal content comes with the expectation that they're making reasonable efforts to control the distribution of said content.

Your words. Grok was an example, the owner is irrelevant in the discussion.

Really showing that you aren't engaging in good faith and your repeated incorrect interpretations of my words are out of a desire to cover for Musk.

To spell it out for you further, the owner's actions matter. It doesn't matter that it was specifically Elon doing it. The owner promoting the ability to produce and post illicit content is the opposite of making reasonable efforts to control it!

For some inexplicable reason, you've decided to make an entire post I made, about Elon Musk. I was referring to grok as one example of people indicating they wanted anti-porn guardrails, other platforms have been challenged with law suits as well.

If you want, you can substitute character.ai and their need to add age verification, due to pending law suits. It makes no difference. All this noise about Elon is entirely, completely, and absolutely irrelevant to the point I was making. Nothing you have said shows otherwise.

The owners actions, in terms of determining the legal implications for all platforms, for attempts to ban open models, for what guardrails platforms must have, are irrelevant. We're talking about setting standards which will last decades, if not longer, legal precedent, and how this is handled will change the entire marketplace.

Some tweets you didn't like have no importance in this kind of discussion. The stance of an owner of one company, have no importance in this discussion. Grok was used as an example, there are others, as cited above.

No, it doesn't matter that Musk this and Musk that. I don't care. It's not relevant.

You've missed the entire point I was making, entirely and completely, which was that there can not be two standards. If it's illegal to have a model produce porn, or CSAM, or whatever, then it must, I repeat must be application agnostic, be regardless of how that model is run.

Yet here you are, almost frothing at the mouth, on and on about Musk. You're like a bull that saw red somewhere. I don't care about whatever US style politics are involved here. I don't care about Musk. Musk, or US politics are not important to me. Musk has nothing to do with the point I was making.

I don't know how to make this any plainer to you. Any response where you talk about Musk, is an incorrect response. This thread isn't about Musk. I don't care about Musk. I don't care about your opinions of Musk.

Hopefully the above clears up your incredibly weird, out of the blue obsession with Musk as a topic in this thread.

At this point I just have to assume that you're trolling. Idk how much more explicitly I have to say that it doesn't matter who the owner is, it matters what the owner did.