Hacker News new | ask | show | jobs
by bearjaws 5 days ago
Given how "smart" some of the 26b dense models are now, I would not be surprised to see a strong 40b MoE.