[zkmon]

I'm waiting for FP8 quant, preferably from Google.

[mdp2021]

If you accept the "ggml-org":

https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai...

https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai...

[zkmon]

Do they run well on vLLM?