Hacker News new | ask | show | jobs
by peakji 600 days ago
GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf

I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?

1 comments

You can now run any huggingface model using the following command

ollama run hf.co/{username}/{repository}

Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M

Source: https://huggingface.co/docs/hub/en/ollama