Hacker News new | ask | show | jobs
by therobots927 37 days ago
Are you an anthropic insider or something? Because if you are you should delete this comment. If you aren’t then you don’t know what the hell you’re talking about.
2 comments

For one point, you can look at the costs of similarly sized open-source models from inference providers (which are only making money on the markup on the compute), and compare with anthropic's prices. There's a pretty big price difference there and it would be hard to believe that anthropic's models are that much more expensive to run than those models.
Those prices don't need to bake in the training cost, since it was eaten by someone else (whomever trained the open source models). Anthropic et al. need to price in the whole lifecycle.
Yes, but the point is specifically on whether inference in and of itself is profitable (i.e. whether the unit economics work out). They are still losing money overall, but they're not losing more money the more people use their product (quite the opposite: they need a lot of users at their fairly large per-token margins in order to justify their R&D spend, and the big question IMO is how strong the opposite side is: how much money do they need to spend on R&D to have a product that justifies such a high per-token premium?).
Surely the same can be said for the people saying the opposite?
I didn’t make a claim. The parent explicitly said it was a misconception that inference is not profitable.

No one knows if it’s profitable or not so we’re left to speculate.

You can make a fairly decent assumption by calculating the margin on serving glm 5.2, and adding say 30% extra costs and it still leaves a healthy margin
Where are you getting 30% from
It was a rough heuristic for how much more opus/5.5 would presumably cost if you extrapolate from glm5.2 prices. In any case input tokens for 5.4/4.6 are 70-100% more expensive, cached about 3-100%, and output tokens anywhere from 60%-240% more as per all their current api pricing. I highly doubt 5.4/4.6 are that much more expensive to serve given how cheap and commoditized inference has become, and how comparable they are perfomance wise.