[datascienced]

Before getting deep in Rabbit holes and paying $1k to fine tune something, consider using OpenAI assistants API. You can experiment with it in the Playground without writing code and that itself might be enough! Or write some code to put your UI over it. Then once you have digested your own dog food you might have a product to sell too!

[kcorbitt]

Just to correct the record a bit, while you certainly can spend $1K+ to fine-tune a model we've found that the average user on openpipe.ai spends less than $30 per fine-tune. It actually takes quite a lot of data (likely more than the OP has produced in their interactions with the forum) to crack $100 in fine-tuning costs!

Of course this is heavily dependent on what you're using for source data. And in any case, the OP would certainly be spending far more than $30 in time trying to get their data in the right format, which may or may not be a good use of time based on how excited they are about learning the process end-to-end. :)

[kordlessagain]

Would a model actually perform better fine tuned on such a small data set? Seems to me that just giving it the data during inference of new stuff would net better results, using something like RAG.