[wolvoleo]

Just install ollama.

And no, they're not as capable as SOTA models. Not by far.

However they can help reduce your token expenditure a lot by routing them the low-hanging fruit. Summaries, translations, stuff like that.

[ramon156]

no need for ollama, simonw's llm tool is good enough

[wolvoleo]

Oh I don't know that one. I just mentioned ollama because it makes things easy for the user.

But looking at it it's just an interface to the cloud LLMs? The OP's question was about local models.