|
|
|
|
|
by juangcarmona
244 days ago
|
|
Really glad to see DMR getting "new life"... I’ve been experimenting with it for local agentic workloads (MAF, Google's ADK, cagent, Docker MCP, etc...) and it’s such a clean foundation... A few things that could make it even more powerful (maybe some are out of your scope): - Persistent model settings (context size, temperature, etc.) across restarts — right now it always resets to 4k, which breaks multi-turn agents.
- HTTP/gRPC interface to let tools and frameworks talk to DMR directly, not only through the CLI. (Here the issue is on Docker MCP side, right?)
- Simple config management (`docker model set` or `docker model config`) so we can tweak GPU, threads, precision, etc. predictably. (there are at least a couple of issues on this topic already...) TBH, I love how fast the discussion evolved today. Congrats and good luck with this.
I'll try to help, promised! |
|