[amemi]

Possibly the original X tweet that popularized this list? 2024, 876k views

https://x.com/keshavchan/status/1787861946173186062

In my opinion, whether it was actually by Ilya or not is not worthy of debate. Many of them are widely recognized for being good pedagogical resources (e.g. annotated transformer, unreasonable effectiveness of RNNs, understanding LSTM networks), and others are landmark papers which anyone interested in the field would benefit from reading:

- Krizhevsky et al. (2012) introduced AlexNet

- Bahdanau et al. (2014) introduced attention

- He et al. (2015) introduced ResNet

- Vaswani et al. (2017) introduced the Transformer

Other papers are more specialized. Of them, I think Kaplan et al. (2020) by OpenAI is probably most important.

[gekoxyz]

Even if Ilya didn't really create this list I have a very good opinion about every paper on this page that I've read (most of them) so I think it's a great resource. Lately during my off time I want to do something related to AI research (which I am already doing full time atm so I need something light) and I am for sure going to read through this.