[robrenaud]

Does the model quality become degraded in other ways?

[HenryNdubuaku]

no because we freeze the main weights and only train our added weights.

[zamadatix]

It's impossible to add weights which degrade the quality?

[jstanley]

Not if the new weights don't influence the old outputs.

[zamadatix]

Aha! I thought this was feeding the confidence info back to Gemma for some reason.