Hacker News new | ask | show | jobs
by schmeichel 600 days ago
This seems promising! Great work! Any chance there will be a Ollama Modelfile for the masses?
1 comments
peakji 600 days ago
GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf

I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?

link
ca_tech 599 days ago
You can now run any huggingface model using the following command

ollama run hf.co/{username}/{repository}

Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M

Source: https://huggingface.co/docs/hub/en/ollama

link