[lukewarm707]

i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice.

there are many cloud providers of zero data retention llm APIs, and even cryptographic attestation.

they are not throttled, you can get an agreed rate limit.

[l72]

Would you mind naming some of your favorite providers?

[lukewarm707]

API: fireworks

Fast: inception labs or cerebras

Confidential: tinfoil.sh, phala

TTS/STT: groq

Routers: vercel (or openrouter if they don't have the model).

Search: unsolved, just can't get zdr, local hosted.