Y
Hacker News
new
|
ask
|
show
|
jobs
by
minimaxir
68 days ago
The more efficient tokenizer
reduces
usage by representing text more efficiently with fewer tokens. But the lack of transparancy does indeed mean Anthropic could still scale down limits to account for that.