[ComputerGuru]

So what we want now is unsloth (or anyone) to release 4/6-bit quantized models of these releases?

[coder543]

Yep, Unsloth already did, as linked in the comment at the top of this thread