[mottosso]

A lot of hate for Ollama in this thread. Am I understanding correctly that it is all based on not crediting llama.cpp correctly? I can't find any other argument against it, other than some minor performance differences. Where Ollama stands out is user interface. It's easy to overlook how difficult and important that is.

[Towaway69]

I dumped ollama yesterday after reading a similar thread. I definitely don’t condone what ollama has done but yes, definitely their UX is far better - as an end user.

Their docker-like extending and defining new models is really simple (coming from a docker background).

Installing new models with llama.cpp seems nontrivial. Perhaps it was using the mac dmg instead of curl-pipe-sh.

Unfortunately then llama.cpp crashed my laptop - no error, no feedback, just frozen desktop and reboot.

Went back to a much slower experience with ollama but it just works out of the box… sorry to say.