[mensetmanusman]

Having dealt with near and distant family psychosis on more than one occasion…

The truth is that the most random stuff will set them off. In one case, a patient would find reinforcement on obscure YouTube groups of people predicting the doom of the future.

Maybe the advantage of AI over YouTube psychosis groups is that AI could at least be trained to alert the authorities after enough murder/suicide data is gathered.

[raxxorraxor]

I don't think AI informing authorities (who would do nothing) is in any way desirable.

At some point you have to just live with marginal dangers. There is no technical solution here.

[mensetmanusman]

Wouldn’t have to be ‘authorities’, but for people with broken families, authorities who knock on the door and check for a health crisis are literally all that they have.

(We have family that would be homeless if we hadn’t taken them under our wings to house them).

[raxxorraxor]

I am sorry to hear that. But these problems would still not justify surveillance of users with a direct line to authorities. In some countries these can be quite abusive. For people that such engagement with AI is dangerous should look for other means.

[simianwords]

a nice way to convey this is: the optimal amount of such mishaps is non-zero.

[Avicebron]

I'd prefer using chatgpt or claude or whatever doesn't mean someone gets swatted when they get heated about "kill this damn thread"

[recursive]

I doubt this is all going to end up according to any of our preferences.

[garyfirestorm]

Minority Report coming to life

[IIAOPSW]

More like plurality report

[ChrisMarshallNY]

I have very close family with schizoaffective disorder.

This story is pretty terrifying to me. I could easily see them getting led into madness, exactly as the story says.