|
|
|
|
|
by kiwicopple
949 days ago
|
|
from first glance, it looks similar to LiteLLM[0]. Are there any key differences? Also, in light of this weekend's madness, are you reconsidering using the OpenAI API as the canonical interface? Do you think there could be changes in the future? [0] https://github.com/BerriAI/litellm |
|
a) This is hosted b) Supports caching and load balancing c) Can manage multiple providers behind a single API key d) Implemented in Typescript (vs. Python)
On the other hand, LiteLLM is a more mature project and supports significantly more model providers than we currently do!