[kcorbitt]

Just to correct the record a bit, while you certainly can spend $1K+ to fine-tune a model we've found that the average user on openpipe.ai spends less than $30 per fine-tune. It actually takes quite a lot of data (likely more than the OP has produced in their interactions with the forum) to crack $100 in fine-tuning costs!

Of course this is heavily dependent on what you're using for source data. And in any case, the OP would certainly be spending far more than $30 in time trying to get their data in the right format, which may or may not be a good use of time based on how excited they are about learning the process end-to-end. :)

[kordlessagain]

Would a model actually perform better fine tuned on such a small data set? Seems to me that just giving it the data during inference of new stuff would net better results, using something like RAG.