[chipsrafferty]

Are you saying if I ask a prompt "foo" and then a month later another user asks "foo" then it retrieves a cached value?

[wkat4242]

No, the key value cache is the context in a way the model can read it.