[ribeyes]

Sounds compelling. Where can we try it out? We need to compare the results with GPT-2 to see how it performs.

[thats_legit]

https://github.com/NVIDIA/Megatron-LM

[the_good_guy]

Pytorch implementation