Hacker News new | ask | show | jobs
by wmedrano 726 days ago
Main reason I started using ollama is because it actually worked. I spent half an hour trying to get huggingface models to run on my GPU with no success. Meanwhile `sudo pacman -S ollama-rocm` seemed to just work out of the box.
1 comments

Exactly, and as a bonus it runs an JSON API on localhost so you can call it from anything on your LAN, it's really, really amazing