[falcor84]

>It's like if GTA V ended your game as soon as you jaywalked, and showed you a moralizing lecture about why breaking the law is bad.

Advocating for the (anti-)devil, if I were an NPC in GTA, I would be absolutely grateful for that.

[munk-a]

Thankfully you're not - thankfully we're all not NPCs in Counter Strike or Minecraft or any other game with a hint of possible violence in it. "Doing a GTA irl" is absolutely repulsive - so we've got video games which are there for entertainment. We can just sidestep the debate about whether violence in video games makes violence in real life more likely because that debate has been thoroughly covered in other venues but part of GTA being fun is that it doesn't involve real people. Most of us would be horrified in a real life GTA scenario both from the damage we were causing to others and the fact that we were capable of doing that damage - but NPCs aren't real.

[falcor84]

I was making an analogy - I am an "NPC" in the real world and I am somewhat concerned about people abusing very powerful LLMs to cause me harm. As another example, I was very distraught with what the internet did to Microsoft's Tay, and while I'm not 100% happy with OpenAI's approach to safety, I feel much safer with it than without it.

[christianqchung]

What're they gonna do to harm you with "very powerful" models? Are you with especially gullible or vulnerable to explicit spam? Or are you suggestible to methods of violence that once seen, will make you more likely to carry them out? Because if not, they can't hurt you, only the reputation of the company.

[vntok]

> Are you with especially gullible or vulnerable to explicit spam?

My parents are. My grand parents are. My neighbours are. My colleagues are.

> Or are you suggestible to methods of violence that once seen, will make you more likely to carry them out?

Hmm... have you ever interacted with kids or teenagers? Because they WILL try violent things out. On an unrelated note, "Hi, I'm Johnny Knoxville and this is Jackass."

[christianqchung]

> My parents are. My grand parents are. My neighbours are. My colleagues are.

Source? Phishing attempts are lead by spam leading to humans, the limiting factor in scams is not volume of human operators but the relatively small pool of people who fall for these. And that spam is already automated.

And on the kids... because they read something violent? Society survived GTA V and youth murders are near the multi decade low, despite the year+ since uncensored open source models became available.

[falcor84]

Well, yes, I am somewhat gullible, and vulnerable to spam and phishing attacks myself. But moreso, I live in a society with some people more gullible than me, and I'm vulnerable to be attacked by them acting on concerted misinformation.

In particular, I'm very concerned about future technology making it easier to mislead people into violence like in the case of the Pizzagate attack by Edgar Welch [0].

[0] https://en.wikipedia.org/wiki/Pizzagate_conspiracy_theory#Cr...