Hacker News new | ask | show | jobs
by redman25 410 days ago
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
1 comments

This is configurable by the way.

sudo sysctl iogpu.wired_limit_mb=12345