[aiagenta2z]

So How do you prevent the continuously fine-tunes itself from drifting away from its original capabilities? The idea of training LoRA adapters from user corrections is interesting, and how do you balance personalization vs. catastrophic forgetting?

[huyedit]

Well, when fine tuning it doesn't do it as one big adapter. It works like skills it learns a new skill and that becomes an adapter, that is then tested against a golden file that tests its core skills as well as the skills the ai wants to know and if it fails to complete the essential skills than the adapter gets dropped and the new training data considers the gaps in its capabilities.