Hacker News new | ask | show | jobs
by czyhandsome 993 days ago
Do you support custom LLMs?
1 comments
jackmpcollins 993 days ago
At the moment only those that support the OpenAI Chat API, with function calling for the structured outputs. For example you can use LocalAI[0][1] to run models locally.

[0] https://github.com/go-skynet/LocalAI

[1] https://localai.io/features/openai-functions/

link