|
|
|
|
|
by juancn
33 days ago
|
|
90% of my model use is on local open-weights models. The things that I need to automate do not need frontier models. Heck, even a gemma-4-12B-it-qat-UD-Q4_K_XL can deal with a lot of complexity if properly guided (it can run on 16GB of unified memory, for example on a base model Macbook Air). I've been using it to translate Javascript to a custom scripting language in a product I work for, just by providing a system prompt and an MCP tool to call the target compiler to check for errors. Sometimes it converges faster than Opus 4.6 (I've tried) because it doesn't over-think stuff. If it were a person I would say it knows less, but it's still smart. I mean, you don't need the most powerful tool at all times.
We treat AI as one-size-fits-all, and once cost gets in the way, it will matter. |
|