Y
Hacker News
new
|
ask
|
show
|
jobs
by
lhl
306 days ago
You're right on ratios, but actually the ratio is much worse than 6:1 since they are MoEs. The 20B has 3.6B active, and the 120B has only 5.1B active, only about 40% more!