Hacker News new | ask | show | jobs
by ridiculous_leke 104 days ago
Can people drop a good LocalLlama setup that I can run on M4?
1 comments

Not sure about LocalLlama, but have you tried LMStudio? If you use Zed it will auto-pickup whatever model you enable on LMStudio. I keep meaning to write a blog post about this for people unaware that you can pair the two pretty easily on a Mac. I mostly use CC but like to test offline models now and then to see how far they've come along.
I use Ollama to run local models but have never used one with CC. Curious what models work best for people.
I use Zed with its Claude Code integration, and if I wanna use any other LLM I use LMStudio which is nice on the Mac, and hosts the APIs for it, Zed knows which models are available which is a plus.