a well made (as in, unsloth) smaller quant will help a good amount here, without a notable reduction in performance or increase in perplexity