[saurkt]

(Similar to the response for another question.) BERT is a language representation model while Turing-NLG is a language generation model (similar to GPT). They are not directly comparable (they can potentially be massaged to mimic the other, but, not something that we have done yet.)

[SomewhatLikely]

Google's T5 paper pretty convincingly combines the two doesn't it?