[version_five]

Awesome, thanks for the reply. It's been on my list to try transformers instead of (mainly) Resnet for a while now.

[stevenwalton]

Sure thing. Also if you're getting into transformers I'd recommend lucidrains's GitHub[0] since it has a large collection of them with links to papers. It's nice that things are consolidated.

[0] https://github.com/lucidrains/vit-pytorch