[ushakov]

Thank you! I’m working on supporting local llms via llama.cpp currently, so cost won’t be an issue anymore

[nbbaier]

Given that the ollama API is openai compatible, that should be a drop in, no?

[ushakov]

Not really, I believe it’s missing function calling

Edit: and grammar as well

[nbbaier]

Ahh yeah gotcha