[boo-ga-ga]

Love the project! Just read about grimoires with prompts by Ethan Mollick https://open.substack.com/pub/oneusefulthing/p/now-is-the-ti... and this looks like one of the ways to store your prompts! Having a caching layer also seems useful from cost point of view. I can imagine that with sufficiently large number of users their prompts and responses sometimes will be similar, and this provides space for cost savings, nice idea:)

[trentearl]

Thanks, thats a great blog post. I never thought of using prompt as interactive instructions like that.

Yes the cacheing is super helpful for certain use cases, like composing multiple prompts. I'm working on an app for learning languages via reading, where you see the translated text with grammar and when you hover over a word it shows the matching word from translation to source. This kind of app entails many Ai requests, because youre looping and feeding the result of one prompt into other prompts. Kind of like aws step functions. The cacheing really makes these kind of orchestrated workflows possible from a developer experience perspective.