[tobltobs]

> The focus of many shipping conversations is how to address even unmeasured potential risks to these metrics. A huge number of experiments are run specifically targeted at improving these metrics.

How do you run tests on unmeasured metrics?

[mgraczyk]

How to "address", not "test". For example, you can add logging for specific cases or patterns that you expect to be problematic. You can spot check scores on individual ranked entities. You can do additional analysis or run experiments on certain subsets of the userbase to measure the impact on important groups of users.

[tobltobs]

How do you "measure the impact on important groups of users"?