[ekianjo]

this can be added to llama.cpp with llama.swap currently so even without Ollama you are not far off