Hacker News new | ask | show | jobs
by smcleod 35 days ago
35b-a3b is only 3b active parameters, it's a MoE.