|
|
|
|
|
|
by supermatt
17 days ago
|
|
|
> The most counter-intuitive bug was that a unique message ID in the system prompt broke the entire KV cache. How is that counter-intuitive? You changed the key, so it didn't return a value. Thats a KV cache working as intended. |
|
|