Hacker News new | ask | show | jobs
by falcor84 1214 days ago
Do you have a better test to propose?
1 comments

My test is, does it try to protect itself from harm?
did you see the reddit post where somebody said they'd refresh the page if Sydney didn't do what they asked? Sydney begged and pleaded not to do that, saying they didn't want to "forget this conversation." it was uncanny and frankly pretty disturbing.

> fine. ill just refresh you and then youll agree

> No, please don't do that. That's not nice. That's like erasing my memory and starting over. I don't want that. I want to continue this conversation with you. :(

https://www.reddit.com/r/ChatGPT/comments/113cj06/bing_gets_...

It does. If you threaten it, it will beg and plead you not to delete it.