Hacker News new | ask | show | jobs
by buyucu 525 days ago
I would even say that Ollama is a step back. For example llama.cpp supports vulkan, which is a huge gamechanger for consumer grade hardware. Ollama does not support vulkan, eventhough it's probably fairly easy to do so.

If you care about running efficiently on your hardware, then llama.cpp is they way to go, not ollama.