Y
Hacker News
new
|
ask
|
show
|
jobs
by
redman25
410 days ago
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
1 comments
tstrimple
409 days ago
This is configurable by the way.
sudo sysctl iogpu.wired_limit_mb=12345
link
sudo sysctl iogpu.wired_limit_mb=12345