Hacker News new | ask | show | jobs
Structural Decoding (Function Calling) for All Open LLMs (leptonai.medium.com)
6 points by jiayq84 901 days ago
1 comments

General availability of the structured decoding capability for ALL open-source models hosted on Lepton AI. Simply provide the schema you want the LLM to produce, and all our model APIs will automatically produce outputs following the schema. In addition, you can host your own LLMs with structured decoding capability without having to finetune