Hacker News new | ask | show | jobs
by samus 194 days ago
It would make sense to repeat the experiment with the tokenizer of an LLM.
1 comments
sebastianmestre 194 days ago
Pretty sure that OpenAI uses BPE in their GPT models
link