Hacker News new | ask | show | jobs
by embedding-shape 2 days ago
> If you get close in output quality, then does that matter?

When you're trying to estimate/infer the costs of serving the tokens and even include the cost of training the weights in order to output tokens then yeah, why wouldn't that matter?

1 comments

That only matters if you are an investor not if you are a consumer.
Well, or if you're participating in a discussion on HN where the sub-topic happens to be "if labs are subsidising tokens on API pricing" and literally the cost of serving the tokens is relevant to the sub-topic people are trying to discuss...
Consumers want better models too, of course it matters