|
|
|
|
|
|
by colah3
441 days ago
|
|
|
Yep, that’s right! If you want to be precise, there are “autoregressive transformers” and “bidirectional transformers”. Bidirectional is a lot more common in vision. In language models, you do see bidirectional models like Bert, but autoregressive is dominant. |
|
|