[robotresearcher]

If I buy a hammer and smack myself in the face with it, no one blames the hammer.

Engage this friendly neighbor chatbot about euthanasia, the holocaust, polarized politics and you discover it talks in a friendly way about those subjects. It’s not broken. You did that to yourself.

You can make an innocent typewriter output hate speech if you press its buttons purposefully.

[pixl97]

And if the hammer comes with a label that says "it feels good to hit your face with this"?

We'll have to accept the world isn't binary in many situations. There are gradients from "you should know better" to "outright criminal behavior from a device".

[K0balt]

Oh, definitely. I totally agree.

But some people are delusional and sufficiently isolated that they will attribute real significance to affirmation from a piece of software in their emotional sensorium.

Which makes me wonder how long it will be before someone builds a girlfriend app that is super awesome and supportive and “loving” for months but eventually breaks it off after a chat with another user “leaks” into your context lol.

A cheatbot, if you will.

I’m sure it would be effective in nudging a certain cultural subset to a whole new level of weaponised mysogeny, for the views of course.

I think I might be in the wrong timeline.

[decae]

This is a precursor to a Rule 34 of AI. If you can think of it, it exists.

[Norvin_Chan]

Girlfriend AI apps are a well-established business model. It already exists in the form of Replika and its many competitors! Its model will sometimes talk about cheating on its users.

See for example: https://www.reddit.com/r/replika/comments/1305q4v/my_replika...