Hacker News new | ask | show | jobs
by neillyons 789 days ago
> We had issues with consistent JSON ouput [solved]

It says the JSON output is constrained via their platform (on la Plateforme).

Does that mean JSON output is only available in the hosted version? Are there any small models that can be self hosted that output valid JSON.
2 comments
PhilippGille 788 days ago
> Are there any small models that can be self hosted that output valid JSON.

Yes, for example this one is optimized for function calling and JSON output: https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B

link
ajcp 788 days ago
> Does that mean JSON output is only available in the [self]-hosted version?

I would assume so. They probably constrain JSON output so that the JSON response doesn't bork the front-end/back-end of la Plateforme itself as it moves through their code back to you.

link