Hacker News new | ask | show | jobs
by bitexploder 29 days ago
It also comes down to inference speed, not "can I run this". 8-bit quant is quite a bit slower on an M5 Pro.