[CharlesW]

Support for llama.cpp seems like it'd be really interesting for folks who don't want to send data back and forth to LLMaaS providers. https://github.com/ggerganov/llama.cpp

[spstoyanov]

Makes sense! I will look into it