Hacker News new | ask | show | jobs
Tokenization Is a Problem for LLMs (blog.dottxt.co)
2 points by remilouf 872 days ago
1 comments

This article presents a way to make structured generation with LLMs much faster than standard generation, but what I find most interesting is how it highlights the issues that tokenization entails towards the end.