[layer8]

How long does training a 1B or 500M model take approximately on the 4-GPU setup? Or does that dramatically depend on the training data? I didn’t see that info on your pages.

[sabareesh]

Roughly it takes 7 days to train on 100B tokens on 500M model