Y
Hacker News
new
|
ask
|
show
|
jobs
by
maaaaattttt
47 days ago
Could it be that Anthropic is using the Chinese characters trick to consume less tokens behind the scenes?
2 comments
noddybear
47 days ago
Aren’t Unicode characters generally treated as 2 tokens to avoid a huge vocabulary?
link
winrid
46 days ago
It used a chinese character instead of the word "true"
link