Hacker News new | ask | show | jobs
by merlindru 8 days ago
models are hungry for a more information-dense language

for now all they've got is english, so they'll just bend that into shape. it'll do.

1 comments

I've heard chinese contains more information per token
Definitely — the language comes pre-tokenized!
Finally an advantage for Chinese after being penalised during the early stage of compute!