|
|
|
|
|
|
by jychang
133 days ago
|
|
|
On the other hand, Deepseek V3.2 is $0.38 per million tokens output. And on openrouter, most providers serve it at 20 tokens/sec. At 20t/s over 1 month, that's... $19something running literally 24/7. In reality it'd be cheaper than that. I bet you'd burn more than $20 in electricity with a beefy machine that can run Deepseek. The economics of batch>1 inference does not go in favor of consumers. |
|
|
You can run agents in parallel, but yeah, that's a fair comparison.