[SimianSci]

Id personally be interested to know how this compares to a solution such as Ollama, which I have been using to run local models.

[talldayo]

Linux users have a pretty excellent native Ollama client called Alpaca, it's well worth checking out: https://flathub.org/apps/com.jeffser.Alpaca

It's still early in development but supports multimodal and some nice looking code blocks.