[smetannik]

I wonder why something like LM Studio didn't work for the author?

[b3ing]

That’s what I was wondering, lm studio and draw things are easy to use apps that handle much of the cruft for you

[freerunnering]

I do a lot of fine tuning and development with small models themselves (not just using an LLM over a HTTP API). So downloading the models directly and running them from the CLI was natural for me, so that's what I reached for when I wanted to play around with this.