|
|
|
|
|
|
by preetham_rangu
27 days ago
|
|
|
Really impressive for a 13 year old, and refreshingly honest writeup. The failed self-correction section is the best part: six methods tried, six negative results reported instead of buried. That's rarer than the architecture itself. Curious whether the shared+LoRA bidirectionality idea holds up once you run it past 2000 steps. |
|
|
yeah for the next training run im planning on testing that out extensively before putting into training