[robotswantdata]

Why are you using Ollama? Just use llama.cpp

brew install llama.cpp

use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app

[Bigsy]

For MLX I'd guess.

[wronglebowski]

That also comes upstream from llama.cpp https://github.com/ggml-org/llama.cpp/discussions/4345

[redrove]

https://omlx.ai/

[leftnode]

Does this have a CLI only interface?

[redrove]

Yes. You could also look at the README.md.