|
|
|
|
|
by JasperNoboxdev
84 days ago
|
|
We've tried a bunch of approaches, always comes down to the same few things: - Built internal tooling to keep keys out of AI chats and anywhere they could leak. The moment a raw key enters a conversation or a shared space, you've lost control of it. - LLM gateways with capped virtual keys per developer and separate service accounts. If a key leaks, it's easy to kill, doesn't affect the product, and the damage is capped — not your whole billing account. - A scoped intermediary layer for any autonomous agents. Anything running without a human in the loop gets its own access that we can kill in seconds. We ended up building some custom tooling here specifically for working with AI agents. There's always this tension between the easy way (just paste it into the chat, it'll be fine) and the proper way, which usually ends up being too cumbersome for anyone to actually follow. |
|