Hacker News new | ask | show | jobs
by dofm 17 days ago
It’s still a dense model so all 27B parameters are active. 35B-A3B activates only 3B at any time.