[bitL]

e.g. XLNet:

https://arxiv.org/abs/1906.08237

[phreeza]

XLnet is Bert with a bunch of additional training tricks.

[bitL]

BERT is a Transformer with a bunch of additional training tricks. Transformer is self-attention with a bunch of additional training tricks...