[orlp]

You don't even need that for JSON. JSON can be expressed using a LR(1) grammar, so you can do it in linear time and space.

[gamegoblin]

Yes, the llama.cpp work supports arbitrary CFGs, not just JSON