That's not a great comparison. Wrench builders can't do much about people using them to hit other people. LLM builders can do a lot to prevent nudification attacks.
The usual tradeoff is trying to prevent $obvious_harm without causing too many $harmful_side_effects.
What are the harmful side effects of preventing nudification attacks?
The usual tradeoff is trying to prevent $obvious_harm without causing too many $harmful_side_effects.
What are the harmful side effects of preventing nudification attacks?