[senordevnyc]

You need evals. I found this post extremely helpful in building out a set of evals for my AI product: https://hamel.dev/blog/posts/evals/

[eevmanu]

+1 to evals

https://github.com/anthropics/courses/tree/master/prompt_eva...

https://cookbook.openai.com/examples/evaluation/getting_star...