|
|
|
|
|
|
by rustyhancock
129 days ago
|
|
|
There's two paths here. Bottom up and top down. Bottom up would roughly be
1. Picking a simple introduction to programming textbook ideally Python
2. Work through a building a transformer LLM in python
3. Move to training it on a corpus You're not mastering each step. Reading the python book and doing some exercises is fine. The top down:
This 3Blue1Brown playlist will have you covered
https://youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_... Either way you want to meet in the middle.
There is still a lot in the middle that isn't clear so don't try and work from the middle out! |
|
|