Hacker News new | ask | show | jobs
by cloudking 929 days ago
It looks like it can connect to local models via LiteLLM proxy.

Related issue: https://github.com/danny-avila/LibreChat/issues/1131

LiteLLM: https://github.com/BerriAI/litellm

Guide: https://github.com/danny-avila/LibreChat/blob/main/docs/inst...

1 comments

Good to know, thanks!

I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good.

Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds.

[0] https://github.com/danny-avila/LibreChat/issues/1131