Hacker News new | ask | show | jobs
by wmf 311 days ago
I have no problem with it and I can understand why people don't want to say "I'm trying to pornify this model and it refuses to talk dirty!" in public. But if you're calling a model garbage maybe you should be honest about what the "problem" is.
1 comments

Why? Is there any reason to believe problems in that context won't generalise?
Lots, yes. The fine tuning may attempt to introduce concepts that were intentionally omitted from the training data for safety* reasons.

Maybe nothing wrong with that, but it might mean that the perceived weaknesses don't generalize to an area of the model that hasn't been lobotomized.

* using safety the way OpenAI have been using the term, not looking to debate the utility of that.

Are you serious? Of course there are reasons to believe they won't generalise.