1. We are open-source & self-hosted, while most of the existing solutions are closed Saas tools and many of them ask you to send your data to their servers for analysis
2. We focus a lot on customisation. We allow ML engineers to define custom metrics to monitor (say you are doing human pose estimation, we allow measuring drift on individual key points as well as complex metrics such as body length, torso ratio etc.). In our experience as ML practitioners, these custom metrics are much more insightful that just out-of-the-box statistical measures.
3. We are completing the whole refinement loop. With each check, we define a rule to capture "interesting" or "problematic" data-points (essentially cases where model performance is down) and integrate seamlessly with your existing ML workflows to automatically retrain the model when required
1. We are open-source & self-hosted, while most of the existing solutions are closed Saas tools and many of them ask you to send your data to their servers for analysis
2. We focus a lot on customisation. We allow ML engineers to define custom metrics to monitor (say you are doing human pose estimation, we allow measuring drift on individual key points as well as complex metrics such as body length, torso ratio etc.). In our experience as ML practitioners, these custom metrics are much more insightful that just out-of-the-box statistical measures.
3. We are completing the whole refinement loop. With each check, we define a rule to capture "interesting" or "problematic" data-points (essentially cases where model performance is down) and integrate seamlessly with your existing ML workflows to automatically retrain the model when required