[huevosabio]

Is there a reason for why you wouldn't use something like Outlines or Xgrammar to force a grammar on the output?

[aaronvg]

Sometimes you don't have access to a model, so this approach still works in that scenario.

We also have several users that have anecdotally told us they get worse results using constrained grammar solutions.