Y
Hacker News
new
|
ask
|
show
|
jobs
by
WilliamBerglund
1103 days ago
Yes, tiktoken, here's a client side visualizer for it
https://github.com/functorism/gpt4-tokenizer-visualizer