[janrakete]

I think it’s generally a good idea to use a standalone, local solution. I also like the approach of combining multiple models with different focuses under a single interface. On the other hand, I usually use very specialized models (for programming, for example) and rarely end up generating music or a video on the side. So I can’t think of a reason to use the system right now.

What target audience do you have in mind?

[sawfwair]

That's a great q and point. I built it to get at a broad approach to tying multimodal capability together in one place as I'm personally building products on top of it that stitch chat, image, video together and wanted to enable others to do the same. For just coding/chat/specialized models I'd say ollama or lm studio is still the better bet generally, but for some of the models I care about I'm trying to optimize pretty deeply and make fine-tuning really simple. Plus I'm often supporting and bouncing between Mac and Cuda boxes so wanted something where the same codebase ran on both.