[sahil_chaudhary]

All included it costs under 70$ for the 13B model. Training 65B now so will report what that will cost.

[alex_sf]

For the 65B fine tune, did you add another A100 node? Or just drop batch size?

Any chance you’re up to sharing the training parameters?

[sahil_chaudhary]

Dropping the batch size

[sillysaurusx]

Please do! Also please include how you’re calculating the costs.