Y
Hacker News
new
|
ask
|
show
|
jobs
by
phonon
317 days ago
It will be sort of decent on a 4bit 70B parameter model, like here
https://www.youtube.com/watch?v=5ktS0aG3SMc
(deepseek-r1:70b Q4_K_M). But yeah, not great.