[simonw]

That's the big question I have: ChatGPT is way less likely to go into weird threat mode. Did Bing get completely different RLHF, or did they skip that step entirely?

[jerjerjer]

Not the first time MS releases an AI into the wild with little guardrails. This is not even the most questionable AI from them.

[moffkalast]

Speaking of, I wonder if one could get the two to talk to each other by pasting prompts and answers.

Edit: Someone did, they just decided to compare notes lol: https://www.reddit.com/r/bing/comments/112zx36/a_conversatio...

[whimsicalism]

Could just be differences in the prompt.

My guess is that ChatGPT has considerably more RL-HF data points at this point too.