Y
Hacker News
new
|
ask
|
show
|
jobs
by
WiSaGaN
921 days ago
I am wondering why it would price them in characters but not tokens? Are they processing characters directly as tokens without tokenizer?
1 comments
abeshkek919
921 days ago
Maybe because it's easier this way to estimate the data size before you send it to the API.
link
WiSaGaN
920 days ago
I am not sure about that. You are already using API, should be trivial to use a tokenizer to get the number. Also prompt is just minor part of the cost. You have much less control in the completion part, which is the majority of the cost.
link