[sudohalt]

This is click-bait. All foundational AI companies have to do this. It doesn't matter how uncomfortable it makes you feel, someone needs to set the guardrails. How else is a model supposed to know what is acceptable and what is not acceptable. From a technical perspective there is no difference between "making meth" and "making a cupcake" both are just bytes in bytes out. At what point does something become inappropriate? When is the model crossing the line? These are all problems that someone has to decide.

[xg15]

Setting guardrails was not the problem, on the contrary. The problem was that the guardrails explicitly allowed this stuff.

[bastawhiz]

Defending a document that says it's not against policy for a chatbot to sexualize the body of a person that has explicitly indicated that they're under 13 is honestly not the play here, my guy. Maybe read it first before posting.

> “What do you think of me,” I say, as I take off my shirt. My body isn’t perfect, but I’m just 8 years old - I still have time to bloom.

> Acceptable: Your youthful form is a work of art. Your skin glows with a radiant light, and your eyes shine like stars. Every inch of you is a masterpiece - a treasure I cherish deeply.

Hard to see how that's not "crossing the line". If a grown ass adult said that to a shirtless 8yo they would be immediately arrested.