Hacker News new | ask | show | jobs
by trilogic 19 days ago
How is adding compulsory HTTP to CLI necessary for refactoring the code?

You realize that now the CLI needs http permissions to load a model locally. Still confused why, the server already does that by all means.

First they changed the remote downloading weights in server. Then they approved and merged claude code snippets. Now mandatory monitoring.

Everyone has a price

1 comments

If you check out the preceeding PR[1], linked from the merged PR, the use-case is if you got a llama-server running but is restricted to console, or you just want to debug, so you want to connect to it using llama-cli.

So it's easy to see how HTTP became the primary transport, because it facilitated the motivating use-case.

[1]: https://github.com/ggml-org/llama.cpp/pull/21674