Hacker News new | ask | show | jobs
by DrAwdeOccarim 276 days ago
Minstral small 3.2 Q4_K_M and Gemma 3 12b 4 bit are amazing. I run both in LM Studio on a Macbook Pro M3 Pro with 36GB of RAM.
1 comments
jokoon 275 days ago
can I call it from the command line?
link
DrAwdeOccarim 275 days ago
Yes. LM Studio acts like an OAi endpoint when you turn the server on.
link