Hacker News new | ask | show | jobs
by imtringued 29 days ago
Left behind how? It's been transformers since 2016 and not much actual progress in basic architectures has happened 10 years later. I'm honestly struggling to see how you can be left behind in this field.
2 comments

Obviously, transformers architecture is just one of the ingredients. Otherwise we wouldn't be seeing competing labs in this race. I also read all his interviews as a marketing material.
and CPUs have the same basic architecture since 2000. no progress happened, right?