Valid concern. Your provider API key is never stored — it passes through as a header on each request and is discarded immediately. LLMCap only stores token counts and costs per request. No key retention.
LiteLLM is a great option if you're comfortable running infrastructure. LLMCap is for teams who want enforcement without self-hosting or maintenance overhead.
it was so bugged, the mcp page broke its postgres, many openai compatible type generic providers but not knowing what works. discovered logging was truncated by default, too late. my fault for that last one.
Even has a GUI.
$ uvx capit serve
https://github.com/day50-dev/limit-model-spending
* Free to use
* Everything is stored local.
* Anthropic skills are included for easily extending it to additional tools or providers.
Please ask for features or file bugs. Thanks!
Btw, I'm terrible at marketing even when I'm giving stuff away.