Hacker News new | ask | show | jobs
by spdustin 724 days ago
LiteLLM.

https://www.litellm.ai/
2 comments
ponywombat 724 days ago
LiteLLM seemed to be the best approach for what I needed - simple integration with different models (mainly OpenAI and the various Bedrock models) and the ability to track costs / limit spending. It's working really well so far.
link
emporas 724 days ago
Didn't know about LiteLLM. That seems to be the right kind of middleware most people would need, instead of Langchain.
link