[3abiton]

That's why project like nanochat are really cool, you can get around the limitations of such gigantic libraries, while at the same time understanding the underlying architecture.

[woodson]

Nanochat is using PyTorch under the hood. I don’t understand your point.

[CamperBob2]

They might be referring to Karpathy's earlier micrograd tutorial, where the whole thing is built from scratch. That was how I learned the basics myself.