Hacker News new | ask | show | jobs
by sothatsit 164 days ago
Inference costs falling 2x doesn’t decrease hardware prices when demand for tokens has increased 10x.
1 comments

It's the ratio. If revenue goes up 10x you can afford 10x more hardware if you can afford to do it all.