[crawdog]

SBproxy (https://sbproxy.dev) - An API and AI gateway as a single binary. Sits between your apps and LLM providers to give you more control. Think Cloudflare meets LiteLLM.

After the LiteLLM supply chain hack last month I feel pretty good about that choice. Your LLM gateway holds every provider API key you have. That probably shouldn’t be a pip install.

Worked on API gateway for a major retailer and incorporated my learnings into this platform.

Open source engine take a look!