[lxe]

Ah yes that's right. Well they technically do use a visual transformer for CLIP text encoder as I understand.