[haldujai]

I doubt it would be hard for Microsoft to rebuild, Microsoft Research has made many excellent contributions to transformers for many years now, DeepSpeed is a notable example.

I don’t think they’ve had the will/need to have done this but they most likely already have the talent.