[AussieWog93]

I'm not an AI researcher (would love to hear an actually informed answer on this!), but AFAIK the weights are more or less a black box - you can't easily pinpoint that weights x, y and z relate to Ancient Rome and can therefore be safely removed from a model that's optimised for coding.

[choilive]

You can, and there are many techniques to do so - it's not super precise but you can essentially "delete" concepts out of a model.