| Yes, we use JSON heavily as well. The string replacement feels error prone, and ideally we would have better methods for reviewing full prompts beyond running the code. I’m imagining something like Storybook[0] but for our prompt management. Something that renders the markdown and can do realtime replacement across the different paths we use for generating prompts. For context, we reuse many “wrapper” prompts and then have a few context-specific replacement prompts that are nested within the larger prompts. It works OK for one level of depth, but multiple levels make it hard to interpret from the raw code itself. During dev/runtime, we have some color coordination for the different levels, but again, ideally this was built into the way we store/version our prompts. We’ve looked into a few different prompt analytic/versioning tools, but they all seem too simple for our use-case. [0]https://storybook.js.org/ |