Hacker News new | ask | show | jobs
by sp332 1105 days ago
https://platform.openai.com/tokenizer or the official python library tiktoken https://github.com/openai/tiktoken or this JS port of tiktoken https://github.com/dqbd/tiktoken
2 comments

Thanks for the recommendations. I found the one I needed because of this comment thread.