[dartos]

You can force LLMs to generate valid json by using a context free grammar FWIW

[zuck_vs_musk]

Please elaborate

[kaiokendev]

Matt Rickard has a good entry level blog post about it, from the angle of regex constraining [0]. Context free grammars follow the same principle, except using a finite state machine to restrict the action space.

[0]: https://matt-rickard.com/rellm

[dartos]

Look at llama.cpp grammars, lmql, or guidance-ai