Hacker News new | ask | show | jobs
by mft_ 3 days ago
Thanks.

Agree on the sizing - selfishly, something like a 60B MoE would be great - fast on big machines, and a 4 or 5 bit quant should fit in 64GB and still work well.