Hacker News new | ask | show | jobs
by Aurornis 156 days ago
That's not really an error, that's a fundamental feature of unit economics.

Fixed costs can't be rolled into the unit economics because the divisor is continually growing. The marginal costs of each incremental token/query don't depend on the training cost.

1 comments

You can absolutely have a stab at it. Estimate how long models last for, amortise over that time/number of calls. We've seen enough models go out of fashion for that to be reasonably done.