Hacker News new | ask | show | jobs
by gbgarbeb 44 days ago
Then where did 200M come from? 200,000 tokens?
1 comments

Not all read tokens are included in the context, many of the tokens are from read cache hits. I hit it many times so it grew to 200M. The number came from the API platform.