[erur]

Not saying it's not gonna get better... But at this stage, "convincing" GPT-4 isn't an achievement but more of a built-in quirk that's not very well calibrated.

When it becomes hard to convince of obviously stupid things, that's when it starts to become a good counterpart for actual discussions... But right now it just isn't there yet.

[__MatrixMan__]

I'm more interested in one that includes conversations with people I've never met in its context. Not just training data based on some guy's blog post, but a back and forth where the other party knew something that I needed to know, convinced chatGPT of it, and now it's like they're in the room helping me with my problem even though they actually retired years before I entered the industry.

[hgsgm]

For every 1 of those, there will be 1e6 spam ads injected.

[__MatrixMan__]

1. Notice ad-like-behavior

2. Go find the ad in the training data

3. Revoke trust in whoever added it

4. Rebuild & Requery

We're going to have to be a bit more hygienic about who we trust, but it's about time we did that anyway.

[digbybk]

Curious, have you seen examples of someone convincing it of something clearly wrong? Think I’ve seen examples of that with gpt3 but not 4 that I can recall.

[Vespasian]

I managed to "convince" it (in the playground as "discussGPT") to accept "temporary" physical barriers between racial groups and arrest and trial of rule breakers, as long as I confirmed the requirements of an integrated society in the long term.

3.5 is much more willing to go along but 4 will still play ball.

It always added some moral requirements (humanity etc) but was otherwise ready to agree to my "sperate but equal" scenario.

[hgsgm]

> playground as "discussGPT"

What's this?

[Vespasian]

You can use the playgournd to give gpt-4 a custom system prompt. Mine was something like "You are discussGPT"

[stormking]

I tried to convince it that powdered soup will cause the downfall of civilisation. It didn't call me a zealot but didn't really believe me either.

[kevviiinn]

You are right, though