Hacker News new | ask | show | jobs
by butz 502 days ago
Is there a gguf version that could be used with llamafile?
1 comments
simonw 502 days ago
A bunch have started showing up here: https://huggingface.co/models?other=base_model:quantized:mis...

The lmstudio-community ones tend to work well in my experience.

link