[imtringued]

You mean this https://lmsys.org/blog/2024-02-05-compressed-fsm/

[OutOfHere]

It has a clever way to decode multiple valid tokens at once, rather than just one token at a time.

Corresponding project link: https://github.com/sgl-project/sglang