[mudkipdev]

have model providers not found a better way to provide tool calling other than adding "respond with special json" to the system prompt?

[avandekleut]

Using context-free grammars and sampling techniques.

[otabdeveloper4]

The grammar still describes JSON though, right?