Hacker News new | ask | show | jobs
by yalok 198 days ago
add to it multiple iterations of having to restart pretraining from some earlier checkpoint when loss plateaus too early or starts increasing due to some bugs…