Y
Hacker News
new
|
ask
|
show
|
jobs
by
nbardy
354 days ago
These estimates are way off. The concurrent requests are near free with the right serving infrastructure. The throughput per token per dollar is 1/100-1/1000 the price for a full saturated node.