[nopointttt]

Nice work. How are you doing the cache key when the prompt has a timestamp or session id in it? Regex pass to strip volatile fields before hashing, or do you make the user declare what's stable upfront? I've tried both in my own stuff and neither ends up clean.

[giorgi_pro]

Thank you. No config atm to declare which fields are "stable" for caching. I assume you mean cases where the user would provide a different session ID but still would prefer the key to match. Am I right?