|
|
|
|
|
|
by lostmsu
1431 days ago
|
|
|
Yes, but to my surprise the "compound scaling" provides 3x more improvement in their ablation study. Also, I don't understand Table 8 in their ablation study for aux heads, specifically: why does it have different base benchmark values from Tables 6 and 7? |
|
|