[ggerganov]

Better keep the KV cache in full precision

[freakynit]

Wow.. the GOAT himself.. thank you sooo much for creating llama.cpp ... will re-deploy with full kv cache once requests stop coming.