[CamperBob2]

Have you compared it to the 1.58 bit dynamic quant model based on the original R1 (i.e., not a distillation)? Whatever unsloth did, it doesn't seem to be giving up much reasoning performance over the full Q8 version.

[mluo]

It's simply bc the model is small (1.5B), making it sensitive to weight perturbations