[farouqaldori]

I'm the co-founder & CTO at www.finetunedb.com - and before launching FinetuneDB, I founded a genai app in the application layer (visus.ai) where I built my own in-house testing toolkit.

No matter if you build or buy, what you want to achieve is the following:

1. Visibility over what's going on in production. 2. Ability to identify both good and bad outputs. 3. Performance measuring (custom evaluations). 4. Feedback loop with fine-tuning.

With those pieces in place, you can start making data-driven decisions.

What we've learned so far is that each application is unique, so if you could tell me more about your app I could share some insights.