[cgrs]

Just out of curiosity, why do you need a reverse proxy? Couldn't you connect to that openai-compatible server directly?

[SushiHippie]

Thanks, I don't know why I didn't think of that. Just tried it and it works at least with the llama-cpp-python server, but I suppose some other servers and very likely hosted services (SNI, certificate subjects, ...) would have problems with that.