Hacker News new | ask | show | jobs
by sieve 110 days ago
llama-cpp provides an API server as well via llama-server (and a competent webgui too).