Hacker News new | ask | show | jobs
by juancn 33 days ago
90% of my model use is on local open-weights models.

The things that I need to automate do not need frontier models. Heck, even a gemma-4-12B-it-qat-UD-Q4_K_XL can deal with a lot of complexity if properly guided (it can run on 16GB of unified memory, for example on a base model Macbook Air).

I've been using it to translate Javascript to a custom scripting language in a product I work for, just by providing a system prompt and an MCP tool to call the target compiler to check for errors.

Sometimes it converges faster than Opus 4.6 (I've tried) because it doesn't over-think stuff.

If it were a person I would say it knows less, but it's still smart.

I mean, you don't need the most powerful tool at all times. We treat AI as one-size-fits-all, and once cost gets in the way, it will matter.