https://github.com/OpenAccess-AI-Collective/axolotl
Someone from one of the cloud GPU vendors wrote a guide: https://brev.dev/blog/fine-tuning-mistral