Hacker News new | ask | show | jobs
Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism (github.com)
4 points by yzh 878 days ago
1 comments
ufotalent 876 days ago
An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...
link
QPHutu 876 days ago
Cool!
link