Y
Hacker News
new
|
ask
|
show
|
jobs
by
zozbot234
72 days ago
There's a 31B dense model in the Gemma 4 series that's obviously going to be smarter (though a whole lot slower) than the MoE 26A4B.
1 comments
the_pwner224
72 days ago
I tried it and it was unusably slow at ~5-6 TPS. 26A4B gets close to 40 TPS which is faster than you can read, and still pretty quick with reasoning enabled.
link