|
|
|
Show HN: Xecai, a minimal Python interface for LLM providers for RAG systems
(github.com)
|
|
1 points
by adrianvi
88 days ago
|
|
A small python library to simplify LLM calls, database retrieval, reranking, conversation storage & embeddings when building RAG systems. The library intentionally exposes only the functionality common across providers to avoid provider-specific parameters. Libraries like LangChain provide many integrations but often rely on many abstractions, heavy use of kwargs, and complex code that can be difficult to customize. Features:
- Sync and async APIs
- LLM calls: invoke and stream (temperature, reasoning level)
- Response metadata: answer, token usage, stop reason
- RAG documents: retrieval, reranking, embeddings
- Chat history: conversation store
- Common error handling across providers
- Providers: OpenAI, Anthropic, Google, AWS Retry logic is left to the user (see README). Agent functionality is not supported yet. |
|