|
|
|
|
|
|
by MacsHeadroom
1188 days ago
|
|
|
More like $50 or even $5 or less for the cloud GPUs. Alpaca-7B's compute costs were close to $50 and that was before the 100x cost savings of using LoRA. A 4bit LoRA fine tune of this project would cost less than $5 to train even up to 30B/33B. |
|
|