[simonw]

Is there a GGUF version of your model anywhere that you recommend? I'm on a Mac.

[mluo]

Think there are some people who made GGUFs as branches of our model, try it out!

https://huggingface.co/models?other=base_model:quantized:age...