Hacker News new | ask | show | jobs
by Hendrikto 1162 days ago
> Skipping over BPE as part of tokenization

Well, there are other methods in use. See ByT5, for example.