Hacker News new | ask | show | jobs
by verve_rat 58 days ago
You and I have no way of knowing that.
1 comments
weird-eye-issue 58 days ago
Except that the API cost is literally logged on disk for every session and it's easy to analyze those logs.
link
verve_rat 58 days ago
We aren't talking about API costs or number of tokens consumed, we are talking about number of tokens in a monthly subscription.
link
weird-eye-issue 58 days ago
Again, it is not based on number of tokens. If it was solely based on number of tokens then things like cache misses would not impact the usage so much. It's based on the actual cost which includes things like the caching costs.
link