[ricklamers]

Would be cool if they add support for llama.cpp

[Tostino]

You really want it integrated with an OpenAI API clone rather than directly integrated. Otherwise, interoperability will suffer greatly as new and improved models are released.