Hacker News new | ask | show | jobs
by patates 361 days ago
What models are you using on LM Studio for what task and with how much memory?

I have a 48GB macbook pro and Gemma3 (one of the abliterated ones) fits my non-code use case perfectly (generating crime stories which the reader tries to guess the killer).

For code, I still call Google to use Gemini.

2 comments

I've been using the Google Gemma QAT models in 4B, 12B, and 27B with LM Studio with my M1 Max. https://huggingface.co/lmstudio-community/gemma-3-12B-it-qat...
I would recommend Qwen3 30B A3B for you. The MLX 4bit DWQ quants are fantastic.
Qwen is great but for creative writing I think Gemma is a good choice. It has better EQ than Qwen IMO.