[danielhanchen]

I made some dynamic GGUFs for the 32B MoE model! Try:

./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL

Also a support agent finetuning notebook with granite 4: https://colab.research.google.com/github/unslothai/notebooks...

[anshumankmr]

You guys are lightning fast. Did you folks have access to the model weights before hand or something, if you don't mind me asking?

[danielhanchen]

Oh thanks! Yes sometimes we get early access to some models!

[incomingpain]

As always, you're awesome. keep up the great work!

[danielhanchen]

Thanks!