[tyho]

What's funny is that ollama just runs the llama.cpp example http server on a random port under the hood and proxies requests to it, it doesn't even link against llama.cpp

[v3ss0n]

Yeah they intrusively listen on a port. It is security redflag.