[mentalgear]

I like it and it makes sense, but from a business perspective I wonder what keeps the upstream LLM providers (all trying to generate profits) from offering the same fine-tuning service quickly ?

Edit: OK, right it's olama, so I assume you can download your own model. (Assuming it's downloadable?)

I think openAI already offers fine-tuning with custom data for some of their models, but maybe not specific to coding tasks.

[samatdav]

Yes, you can download and host the fine-tuned open-source model like Llama. The fine-tuning is easy once you have the data, but gathering and cleaning data is challenging. There are also optimizations like upsampling and distillation that could improve the quality of the resulting model. We had 40 engineers at the Asana AI org and never did the fine-tuning because it is not easy.