|
|
|
|
|
by ChadNauseam
56 days ago
|
|
How would it be a money grab? If the new tokenizer requires more tokens to encode the same information, it costs them more money for inference. The point of charging per token is that the cost is proportional to the number of tokens. That's my understanding anyway |
|