Hacker News new | ask | show | jobs
by 3abiton 408 days ago
While not explicitly mentioned, why only openai api is supported? Folks with local LLMs feels left out.
1 comments

This is in the works :) In the past and still today, OpenAI has much better and easier function call support, something we rely on.

We currently are running through LiteLLM, so while undocumented in theory other LLMs could work (in my experience they don't). I’m working on updating and fixing this.