[rubiquity]

llama.cpp and llama-swap do this better than Ollama and with far more control.

[circularfoyers]

Don't even need to use llama-swap anymore now that llama-server supports the same functionality.

[rubiquity]

I did not know that. Thanks for sharing!