|
|
|
|
|
|
by irthomasthomas
42 days ago
|
|
|
I like chutes. I think I get about 5K prompts per day for $20/m, though they may have stricter limits for new customers. This gives you practically unlimited usage of frontier models like kimi, deepseek, glm.
Their models are always fullsize, never quantised except where the lab themselves provides an 4bit or 8bit model. You can see from the model config exactly which hf model it pulls and the serving co figuration used. Prompts are encrypted using Trusted Execution Environment (TEE). So neither a model host or neighbour can view your prompts. That's as close as you can get to local level privacy in the cloud. |
|
|