Hacker News new | ask | show | jobs
by girvo 22 days ago
True, I might be thinking of some of the communities four-Spark clusters for it; it’s already int4 right?
1 comments
Tepix 20 days ago
Yeah, the default quants are 595GB. Even four Sparks would require a quant lower than 4bit
link