Hacker News new | ask | show | jobs
by shcheklein 1816 days ago
Hey, Elena, Emeli, congrats with the launch! Question- am I right, that you don't "dictate" specific monitoring infrastructure? You provide a tool that can take a model and calculate/plot certain important characteristic about it( (e.g. drift)? Do you have a plan to make connectors, templates, some additional infrastructure to simplify integration with Grafana? What other monitoring infrastructure tools you consider integrating?
1 comments

True, we do not want to force users into a rigid workflow. We build the tool so it can integrate with other parts of the ML stack. Right now you can for example use Evidently to calculate if the model has drifted, and then log the results in a JSON format, or take only some parts of the JSON (for example metrics you want) and then send them to an external dashboarding tool. As long as you can process a JSON output or store an HTML file you can build any workflow around that.

We plan to work on tutorials and prepare native integrations with some popular tools like Grafana, MLflow, DVC and some others.