Hacker News new | ask | show | jobs
by htsh 881 days ago
Can one enter their own opeanai URL and api-key? (so we can use openai-compatible things like openrouter or lm-studio)?
2 comments
nullstyle 881 days ago
Doesn't look like it: https://gitlab.com/literally-useful/voxos/-/blob/dev/voxos/s...

edit: shouldn't be hard to enable though

link
Falimonda 881 days ago
Yes, you can define your own key in either the .env, CLI call on run.sh, or in your environment.

https://gitlab.com/literally-useful/voxos/-/blob/dev/.env?re...

link
nullstyle 881 days ago
That doesn't let me send requests to my local litellm instance, though. You have to be able to configure the endpoint that requests are sent against as well.
link
Falimonda 880 days ago
Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
link
nullstyle 880 days ago
Hell yeah. Good luck!
link
Falimonda 880 days ago
Do you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
link
nullstyle 880 days ago
I'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/example...

I don't have any direct experience with it... I've only played around with whisper locally, using scripts.

link
khimaros 880 days ago
https://github.com/mudler/LocalAI
link