[im3w1l]

A key question I think is whether these models can be made safer for mentally ill without cutting into utility for the healthy. Is the danger inherent to this technology, or is it incidental?

And here I think we are fortunate that there doesn't seem to be tradeoff.

[evanextreme]

Agreed here. My personal opinion is that this is fixable, but it would require reinforcement into the models that counteract the sycophantic stickiness that most companies use to drive engagement, so it won't really ever be a priority.