Hacker News new | ask | show | jobs
by perching_aix 304 days ago
Thanks, will check that out as well tomorrow or during the weekend!
1 comments

If you know you want JSON for sure constrained decoding in an inference framework will help. The model is just one part of an overall inference system. I hope this model paired with other tools help you get done whatever it is you're looking to get done