|
|
|
|
|
|
by scosman
449 days ago
|
|
|
Agreed if you are building a typical service. The abstractions will slow you down and don’t and anything. The use case where they are helpful is “bring your own keys” apps. I maintain https://github.com/kiln-ai/kiln which allows you to bring keys for 13 different providers. The abstraction is very much worth it for me. That said: - I migrated from LangChain to LiteLLM and never looked back - I have over 1000 automated integration tests that check the grid of LLM features (tools, json), model, and provider. Without them it would still be a mess. |
|
|