[belter]

What did you use for specs? 32G of memory is enough?

[gregschoeninger]

We used an A10 with 24GB of VRAM, this was enough for PEFT on Mistral-7B