Hacker News new | ask | show | jobs
by wesammikhail 63 days ago
I've seen sources like this before. It's all hearsay and promo. I was asking for any publicly available verifiable information regarding the cost of inference at scale. I haven't seen any such info personally which is why I asked.

I'm dying to see S-1 filing for Anthropic or OpenAI. I don't actually think inference is as cheap as people say if you consider the total cost (hardware, energy, capex, etc)

1 comments

Well they're not public yet so you'll have to put up with rumors. But the numbers are available for companies like DeepSeek say they have an 80% profit margin, so it stands to reason OAI etc would do similar numbers considering they charge much more.
AFAIK,

1. the 80% margin from 2025 was theoretical,

2. they're relying on distillation/synthetic data for training,

3. and have been very opaque about cross-subsidization of R&D with their models.

The distillation alone adds a big asterisk for comparisons.

Talking nonsense.
> you'll have to put up with rumors.

> But the numbers are available for companies like DeepSeek

You'd rather trust self-reported figures? LMAO