Hacker News new | ask | show | jobs
by tomnipotent 35 days ago
Those prices don't need to bake in the training cost, since it was eaten by someone else (whomever trained the open source models). Anthropic et al. need to price in the whole lifecycle.
1 comments

Yes, but the point is specifically on whether inference in and of itself is profitable (i.e. whether the unit economics work out). They are still losing money overall, but they're not losing more money the more people use their product (quite the opposite: they need a lot of users at their fairly large per-token margins in order to justify their R&D spend, and the big question IMO is how strong the opposite side is: how much money do they need to spend on R&D to have a product that justifies such a high per-token premium?).