Hacker News new | ask | show | jobs
by anon373839 134 days ago
The numbers you stated sound off ($500k capex + electricity per 3 concurrent requests?). Especially now that the frontier has moved to ultra sparse MoE architectures. I’ve also read a couple of commodity inference providers claiming that their unit economics are profitable.
1 comments

You're delusional, I didn't even include the labor the install and run the damn thing. More than 500k