Y
Hacker News
new
|
ask
|
show
|
jobs
Running Hugging Face GGUF Models Locally with Ollama [video]
(
youtube.com
)
3 points
by
jexp
985 days ago
1 comments
jexp
985 days ago
Quick 5 minute video on downloading and running Hugging Face language models in GGUF format (quantized by TheBloke) with Ollama on your local machine and checking GPU consumption with asitop (Apple Silicon Mac Top).
link