BERT was 5 years ago. Of course it's worse than anything introduced more recently (both inside and outside Google).
https://en.m.wikipedia.org/wiki/BERT_(language_model)