Hacker News new | ask | show | jobs
by mft_ 3 days ago
Agree - I got 9.7 tok/s on an M1 Max with unsloth's gemma-4-31B-it-qat-UD-Q4_K_XL.