Hacker News new | ask | show | jobs
by smcleod 22 days ago
That's impressive getting a 397B down to <110GB~. HF link is broken though!
1 comments

> That's impressive getting a 397B down to <110GB

It is higher than 110GB. MacOS allows up to 125G of the RAM to be shared with GPU, so it is certainly less than that!

> HF link is broken though!

Doesn't seem broken to me, but you should be able to search for tarruda/Qwen3.5-397B-A17B-GGUF on huggingface.