Hacker News new | ask | show | jobs
by subhajeet2107 25 days ago
LiteLLM already provides this feature, no need of another proxy
1 comments

i did try litellm hosted locally for privacy.

it was so bugged, the mcp page broke its postgres, many openai compatible type generic providers but not knowing what works. discovered logging was truncated by default, too late. my fault for that last one.

moved off it after the trivy incident.