Hacker News new | ask | show | jobs
by embedding-shape 13 days ago
> I am running Qwen3.6-35B-A3B locally on my 16GB mac with 7-9 tokens/second. Link - https://github.com/deepanwadhwa/samosa-chat

It's quite telling you didn't use Qwen3.6-35B-A3B locally to build that, seems there was another collaborator ;)

Show something you've built with the model+tooling instead, truly dogfood it. I'm sure you'll discover things along the way too!

2 comments

Nothing says they're using Qwen for local development. They could be using it to for conversations, knowledge, or "creative writing."
> Nothing says they're using Qwen for local development

I know! That's my point! You're a poor salesman of a coding environment/tool if you don't even use it yourself for coding...

>>It's quite telling you didn't use Qwen3.6-35B-A3B locally to build that

that would have run into a race condition unfortunately ;)

but there is a sample landing page + a python function on the repo which shows what the model produced. my goal is to integrate the local model in my workflow so that claude/OAI can call this model for basic stuff.

> that would have run into a race condition unfortunately ;)

Not really, you start small, bootstrap as soon as you can, and off you go. Requires a good model though ;)