[actionfromafar]

I wonder if the only way to fix this with current LLMs, would be to generate a lot synthetic data for a select number topics you really don't want it "go off the rails" with. That synthetic data would be lots of variations on that "I don't know how to do X with Y".

[dolmen]

I would not bet on synthetic data.

LLMs are very good at detecting patterns.