Hacker News new | ask | show | jobs
by manmal 31 days ago
Have you looked into DwarfStar 4?
1 comments
__s 31 days ago
Been away from home for nearly a month, so was mostly going off Qwen 3.5 122b-a10b (Q4?) / Qwen 3.6 35b-a3b (Q8) / Gemma4 31b (Q8)

Thanks for suggestion tho, tool by antirez is always going to pique interest, I'll check it out when I'm finally home again

Tho says Metal / CUDA, so doesn't seem friendly to Linux AMD system

link
manmal 31 days ago
His quant that fits into 128GB looks interesting for Spark DGX as well IMO.
link