[isaacfung]

The current gen llms tokenize numbers digit by digit unlike earlier llms.

[Last5Digits]

They don't. Which you can easily check with any of the dozen web apps currently implementing the GPT-4o tokenizer.

[mike_hearn]

No, it doesn't help. Bloomberg tried this and it didn't seem to make much difference.

[singularity2001]

If someone else is interested in the Bloomberg tokenizer:

https://medium.com/generative-ai-insights-for-business-leade...