Y
Hacker News
new
|
ask
|
show
|
jobs
by
killthebuddha
1128 days ago
I'm skeptical that the streaming API would really save that much cost. In my experience the vast majority of all tokens used are input tokens rather than completed tokens.