Hacker News new | ask | show | jobs
by verdverm 14 days ago
the new tokenizer (in 4.7+ iirc) produces about 30% more tokens on average