[dontwearitout]

Yep, transformers showed up in 2017, nearly 7 years ago, and they still wear the crown. Maybe some new architecture will come to dominate eventually, but I would love a low cost PCIe board that could run 80B transformer models today.

[imtringued]

If the fairy tale numbers are correct, they could price it at a million dollars and it would still be cheap.