Hacker News new | ask | show | jobs
by lostmsu 2 days ago
27B does, the op was talking about consumer use of DS v4 Flash, that's 160GB.
1 comments

It has been quantized to 80GB (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model, and especially useful in a size range where few "native" models exist.
> (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model

Uh-huh...