[catlifeonmars]

Hmm this is a problem that has long been solved with code completion in a JSON language server and a valid JSON schema.

By this I mean that you can basically tab-complete your way into a valid JSON document matching a particular schema.

Maybe there is a way to restrict the set of output tokens based on the current position in a JSON schema of a JSON document the model is predicting?