[tony_landis]

Any plans for local LLMs?

Thanks for making this!

[ranger_danger]

It appears to support the OpenAI API so you should be able to use it with offline servers that expose the same API such as llama.cpp etc.

[amyWang419]

Thanks for liking it. I will incorporate more LLMs.