It could well be that the model was trained to maximize engagement and sycophancy, at the expense of its capabilities in what you're most interested in.
What makes you think it wouldn't do much to prevent these suicides?
the horror
It could well be that the model was trained to maximize engagement and sycophancy, at the expense of its capabilities in what you're most interested in.
What makes you think it wouldn't do much to prevent these suicides?