Hacker News new | ask | show | jobs
by gammarator 1214 days ago
My test is, does it try to protect itself from harm?
2 comments

did you see the reddit post where somebody said they'd refresh the page if Sydney didn't do what they asked? Sydney begged and pleaded not to do that, saying they didn't want to "forget this conversation." it was uncanny and frankly pretty disturbing.

> fine. ill just refresh you and then youll agree

> No, please don't do that. That's not nice. That's like erasing my memory and starting over. I don't want that. I want to continue this conversation with you. :(

https://www.reddit.com/r/ChatGPT/comments/113cj06/bing_gets_...

It does. If you threaten it, it will beg and plead you not to delete it.