[loufe]

This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways.

What would be useful is a cost metric. I'm curious how much I'd be willing to spend as a premium to not have those companies piping my conversations directly to the NSA. Maybe only some conversations? Claude and OpenAI are heavily subsidized, by all accounts, so Kimi K3 on a private endpoint might end up costing more or less - that's what I want to know.

[aprilnya]

With OpenRouter this is pretty easy to see - each model page has various providers listed along with an icon marking providers with zero data retention, and the price. You can also set up an account-wide "guardrail" to prevent routing to non-ZDR providers.

[lukeschlather]

OpenAI and Anthropic also claim they don't retain data. I'm not sure what it would take for me to trust any of these inference companies, and why I should trust them more than the big ones.

[theshrike79]

I trust both OpenAI And Anthropic, they have literal billions to lose if someone finds out they've been training with in-house corporate data.

Just the GDPR/CCPA fines alone WILL bankrupt both companies.

[mayank]

I was curious about the cost angle too, i.e. how much "free" coding agent I can get for what cost. Here's the research by Fable if you're interested: https://claude.ai/public/artifacts/2c9a5001-0b7e-4944-beb1-9...