[llm_trw]

If you don't know the original training data statistical distribution then catastrophic forgetting is guaranteed with any extra training.

[shwaj]

I was going to ask for a reference to support this (although please provide one if handy), but the search term “catastrophic forgetting” is a great entry into the literature. Thanks.