[the_mitsuhiko]

That kills the KV cache unfortunately. In some models (Gemini) I also doesn’t work because there is a signature on the model messages.