[falcor84]

I was making an analogy - I am an "NPC" in the real world and I am somewhat concerned about people abusing very powerful LLMs to cause me harm. As another example, I was very distraught with what the internet did to Microsoft's Tay, and while I'm not 100% happy with OpenAI's approach to safety, I feel much safer with it than without it.

[christianqchung]

What're they gonna do to harm you with "very powerful" models? Are you with especially gullible or vulnerable to explicit spam? Or are you suggestible to methods of violence that once seen, will make you more likely to carry them out? Because if not, they can't hurt you, only the reputation of the company.

[vntok]

> Are you with especially gullible or vulnerable to explicit spam?

My parents are. My grand parents are. My neighbours are. My colleagues are.

> Or are you suggestible to methods of violence that once seen, will make you more likely to carry them out?

Hmm... have you ever interacted with kids or teenagers? Because they WILL try violent things out. On an unrelated note, "Hi, I'm Johnny Knoxville and this is Jackass."

[christianqchung]

> My parents are. My grand parents are. My neighbours are. My colleagues are.

Source? Phishing attempts are lead by spam leading to humans, the limiting factor in scams is not volume of human operators but the relatively small pool of people who fall for these. And that spam is already automated.

And on the kids... because they read something violent? Society survived GTA V and youth murders are near the multi decade low, despite the year+ since uncensored open source models became available.

[falcor84]

Well, yes, I am somewhat gullible, and vulnerable to spam and phishing attacks myself. But moreso, I live in a society with some people more gullible than me, and I'm vulnerable to be attacked by them acting on concerted misinformation.

In particular, I'm very concerned about future technology making it easier to mislead people into violence like in the case of the Pizzagate attack by Edgar Welch [0].

[0] https://en.wikipedia.org/wiki/Pizzagate_conspiracy_theory#Cr...