|
|
|
|
|
|
by magicalhippo
23 days ago
|
|
|
If you check out the preceeding PR[1], linked from the merged PR, the use-case is if you got a llama-server running but is restricted to console, or you just want to debug, so you want to connect to it using llama-cli. So it's easy to see how HTTP became the primary transport, because it facilitated the motivating use-case. [1]: https://github.com/ggml-org/llama.cpp/pull/21674 |
|
|