|
|
|
|
|
by consumer451
16 days ago
|
|
I personally don't count cached hits as $used... Neither in my harnesses, nor in the LLM-enabled apps I create. A cached token cannot be counted 1:1 as to a non-cached token, that would be silly. Wait... when some Claude 5x/20x users say they are getting "$2000 of tokens for $100," does the 2k value include cached tokens, counted at the same $/token either way? We cannot be this dumb as a community, can we? I must be wrong/misunderstanding.. |
|