Hacker News new | ask | show | jobs
by visarga 606 days ago
yes, look up Byte Pair Encoding

https://huggingface.co/learn/nlp-course/chapter6/5