Hacker News new | ask | show | jobs
by simonw 698 days ago
Maintaining a fine-tuned model for every one of your users - even with techniques like LoRA - sounds complicated and expensive to me!
1 comments

It is, but it's also not that bad. A copy of the weights is X GB of cloud storage, which can be stored as a diff if it helps, and added compute time for loading a custom model and unloading for the next customer. It's not free, but it's an approachable cost for a premium service.