|
|
|
|
|
by ArshDilbagi
607 days ago
|
|
The fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs. - Production-ready and used by enterprises.
- Fully local and NOT a proxy. You can deploy it anywhere.
- Comes with batching, retries, caching, callbacks, and OpenTelemetry support.
- Supports custom plugins for caching, logging, HTTP client, and more. You can use it like LEGOs and make it work with your infrastructure.
- Supports plug-and-play providers. You can run fully custom providers and still leverage all the benefits of Adaline Gateway. Features
Strongly typed in TypeScript
Isomorphic - works everywhere
100% local and private and NOT a proxy
Tool calling support across all compatible LLMs
Batching for all requests with custom queue support
Automatic retries with exponential backoff
Caching with custom cache plug-in support
Callbacks for full custom instrumentation and hooks
OpenTelemetry to plug tracing into your existing infrastructure
Plug-and-play custom providers for local and custom models |
|