Hacker News new | ask | show | jobs
by FusionX 68 days ago
Aren't 4bits model decent? Since, this is an MOE model, I'm assuming it should have respectable tk/s, similar to previous MOE models.