[moffkalast]

Forget ollama, just changing the URL from openai to your local server is enough, llama.cpp has a compatible endpoint. Most people just don't bother giving the option since you get a CORS error if it doesn't have a valid cert.

[freedomben]

Neat, I didn't know that! Thanks for the tip!