[fblgit]

one of a kind single-transformer block layer, high throughput. The new generation of transformer-based lightweight models for common NLP tasks?