Hacker News new | ask | show | jobs
by jnovek 86 days ago
I’m so confused in these comments right now — I thought you had to load an entire MoE model and sparseness just made it so you can traverse the model more quickly.