Hacker News new | ask | show | jobs
Don't Put All Your Tokens in One Basket (theminimalistdeveloper.com)
1 points by rafaelnexus 19 days ago
2 comments
turtleyacht 19 days ago
How do you prepare the fallback if it already took tokens to query the simpler model?
link
rafaelnexus 18 days ago
I don't know if I understood your question.
link
plumman1 19 days ago
don't litellm and similar do this already?
link
santiago-pl 18 days ago
Actually, LiteLLM is the most popular, it was first product of this type, but there is plenty of more efficient and reliable alternate AI Gateways right now. I've written one - GoModel. https://gomodel.enterpilot.io/
link
rafaelnexus 18 days ago
Absolutely, a pretty good one.
link