Hacker News new | ask | show | jobs
by itomatik 844 days ago
how does one finetune llama (or any other LLM) using mistral?

is the flow like this?

- take small dataset

- generate bigger dataset using mistral (how this is this done?)

- run LoRA to fine tune gemma extended dataset.

1 comments

I should have said "run LoRA or your favorite fine-tuning technique to produce your fine-tuned llama."