Hacker News new | ask | show | jobs
by vlit20 462 days ago
How did you measure success of the RAG solution beyond five-star user approvals? Are there any critical metrics that determine success or failure?
1 comments

We have tests in place to make sure every function, every search is working, otherwise things won't deploy. We do have a dashboard with usage etc., but I have not spent much time looking at it. I think we just count broad usage across the company as a success. And yes we consider one-stars and complaints to be a failure, but we get those less often, maybe once every 2 weeks, and it is almost always the user's fault. Does that answer your question?