Hacker News new | ask | show | jobs
by gardenfelder 806 days ago
It seems to be limited to certain LLM servers, on of which is OpenAI, none of which includes e.g. Mystral and popular OSS LLMs.

I wonder if that will change - eventually.

Discord channels are named in Chinese, though there are English posts.

4 comments

It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
Looks like they do but aren't really documented yet:

https://github.com/infiniflow/ragflow/pull/119

I see a `LocalLLM` chat model where it looks like you can pass a host/port (for example, ollama's)
where do you see that?
RAGFlow will support more LLMs, including locally deployed LLMs.