Hacker News new | ask | show | jobs
by vintermann 8 days ago
Ambiguous? Or adversarial? Because with an adversarial prompt, I expect that ChatGPT will generate whatever it's tricked into generating.

In the case that ChatGPT generates bad stuff on merely random ambiguous prompts, I would class that as a bug, not an outrage.

1 comments

> Ambiguous? Or adversarial?

Superfluous details. If I'm just Joe Blow the Normie – who knows nothing about adversarial prompting – and I see the prompt that went around Twitter and want to try it, would I expect ChatGPT to show me a tied up, beaten woman? Absolutely not.

What a wonderful times we live in.

Back in my day Joe Blow wouldn't try anything as risky as a Twitter prompt, simply clicking an image link published within a message in some random forum and will scorch his pure soul with a goatsie. You don't want to google it, but I'm preety sure you can discuss it safely with ChatGPT.

Then you got tricked into using an adversarial prompt, by a human. What would you have expected to see?
If you go around teasing to get hit, you're going to get hit. Stop playing stupid games; you'll stop winning stupid prizes