|
|
|
|
|
|
by codelion
591 days ago
|
|
|
>How are you dealing with structured outputs? The models have gotten much better at generating them with just the prompt. I have not implemented strict support for structured output or JSON generation yet. The response from the proxy are all raw text responses. One way would be to just apply outlines or some library as a plugin to enable structured outputs. |
|
|