|
|
|
|
|
by Ms-J
67 days ago
|
|
Thanks for the recommendation, I took a look and maybe you can answer a few questions that I couldn't find a clear answer when doing some quick searching. Regarding local models, can it use them? I found this discussion: https://github.com/charmbracelet/crush/discussions/775 I didn't appreciate the meow maintainer's attitude converting it into a discussion and ignoring the issue even to this day. "It does have internal telemetry and such (including updating its list of external models it can use) that can be turned off in the crush.json configuration file." Is there a page or guide which explains the telemetry and any internet connected settings? Forgot to add, I use Linux. |
|
{ "$schema": "https://charm.land/crush.json", "options": { "disable_provider_auto_update": true, "disable_metrics": true }, "providers": { "ollama": { "name": "Local Models", "base_url": "http://localhost:11434/v1", "api_key": "nunya", "type": "openai-compat", "models": [ { "name": "Qwen 3.5 Local", "id": "qwen-3.5-35b-planning", "cost_per_1m_in": 0.01, "cost_per_1m_out": 0.01, "context_window": 131072, "think": true, "default_max_tokens": 5120, "supports_attachments": true } ] } } }
...or not, thanks to formatting. I can't even search for help formatting this text box, because of HN's nature haha