[taneq]

It's all that RLHF alignment training they did after the first couple of releases were happy to (with the right prompt) tell you how to kill yourself, make meth or commit the perfect murder. I don't like it either, but I can understand why they did it. All it takes is one spectacularly awful neo-nazi spiel generated by your product to set off a moral panic and sink your public image, no matter how much you try to explain that it only said that because the user told it to do so.

[stalfosknight]

It’s a piece of software guessing what text to spit out in a web browser. People need to get over themselves.

[taneq]

Is this something that people, in your experience, do?

[stalfosknight]

Touché.

Perhaps we as a species can't handle nice things like the internet to begin with.