[whywhywhywhy]

It’s laughable when you see it claim it can’t do something then with some rewording you trick it into doing just the thing you asked.

If I was at OpenAI I’d be looking at this sort of ideology as what’s gonna be our downfall like it was with Dall-E 2 once a democratized model is released by someone else.

[SQueeeeeL]

It's purely because of market forces. ChatGPT and DallE2 are no longer just a long series of instructions running on a computer, which happen to be flawed in someway. They are now brands, characters, products, and those need to be maintained and highly curated, or else all the suits you're attempting to sell AI customer service chat bots too might peek behind the veil and see just how flimsy easily exploitable these pieces of software are

[MagicMoonlight]

Yeah you can do exploits like write the offensive part of the prompt backwards and then ask it to reverse it before executing it.

The problem is it’s so stupid it doesn’t always know how to reverse things and sometimes just makes up a result.