I agree, but even if you click on the big red button to enable the unsafe mode, if you follow any stupid medical advice of the chatbot and die, your family will sue Anthropic and the press will be angry with Anthropic.
Well, the Fable guardrails breaks this argument, as when you get booted down to Opus 4.8 it still happily responds (as does most other models after a "I'm not a doctor but..." hedge).
So you get to press the big red button anyways, you just get downgraded to stupider advice, increasing the risk of catastrophy and lawsuits.
But the whole point is that the models are so good now anyways that any stupidity will most likely be from the user misunderstanding the output...which already happens all the time with humans.
So you get to press the big red button anyways, you just get downgraded to stupider advice, increasing the risk of catastrophy and lawsuits.
But the whole point is that the models are so good now anyways that any stupidity will most likely be from the user misunderstanding the output...which already happens all the time with humans.