Hacker News new | ask | show | jobs
by nbardy 354 days ago
These estimates are way off. The concurrent requests are near free with the right serving infrastructure. The throughput per token per dollar is 1/100-1/1000 the price for a full saturated node.