Hacker News new | ask | show | jobs
by XzAeRosho 719 days ago
It's on HuggingFace already: https://huggingface.co/google/gemma-2-9b
1 comments

I know the safe tensors are there, but I said GGUF 4-bit quantised, which is kinda the standard for useful local applications, a typical balanced sweet spot of performance and quality. It's makes it much easier to use, works in more places, be it personal devices or a server etc.