Hacker News new | ask | show | jobs
by Falimonda 880 days ago
Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
1 comments
nullstyle 880 days ago
Hell yeah. Good luck!
link
Falimonda 880 days ago
Do you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
link
nullstyle 880 days ago
I'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/example...

I don't have any direct experience with it... I've only played around with whisper locally, using scripts.

link
khimaros 880 days ago
https://github.com/mudler/LocalAI
link