[yowlingcat]

You talk to them and the people they work with or whose work depends on them. How quickly, autonomously and completely do problems get solved?

Metrics are a distraction unless in the service of answering that question.

[januzis]

That’s the default, I guess, my main concern is that it’s very subjective.

[yowlingcat]

Sure -- some parts are, but some parts aren't. It's intrinsic to the nature of working in a team or coaching a team. If you notice weak spots consistently, is it a fluke? Probably not. If you notice complaints about the ability of the team, division and org to collaborately smoothly, is that a fluke? Again, probably not. By the time you fine-tune all the weak spots properly, you have a very high functioning team. But it takes a lot of iteration.