Hacker News new | ask | show | jobs
by mrbishalsaha 784 days ago
Really good. I am actually using js-tiktokken and wish there was a package to handle all the other LLMs also but still something I can work with.
1 comments

If you need to work with multiple LLMs, you probably want to use transformers.js
Isn't it to much for just calculating the number of token?
It's the best option you have if you need to work with multiple LLMs in the browser.