Hacker News new | ask | show | jobs
by rootcage 2180 days ago
This is very interesting. Do you support Azure or even custom hosting? Once the model is deployed do you monitor things besides performance? Such as I/O to the model, data drift, etc?
1 comments

Yes, model metrics are monitored when deployed -- performance metrics are enabled by default, and feature / prediction monitoring depends on the framework you're using. You can take a look at an example here: https://app.modelzoo.dev/models/gpt2-twitter-vc?tab=metrics.

We do support deploying to a private AWS cloud in our private beta that we can help get you set up with. Azure is not yet supported for private deployments.