[burrows]

> If your promotion criteria says that someone's qualified for a higher-level job because they've been doing good work in fair weather, you have absolutely no way to know whether they listen to their conscience

How can we possibly know if someone else listens to their conscience? Their conscience is not accessible to anyone else.

[geofft]

I mean, we can go back to the original article for that. Why are we praising McDonald? Why did his obituary get posted here, and why did Mulloy, who passed in October, not get any press? Their consciences were unknowable, yes, but fortunately we're not actually looking for the ineffable conscience. McDonald did a praiseworthy thing, which we wish to encourage. And maybe Mulloy had a stronger conscience, but he just was more deferential to the pressure on him to launch. Maybe he did listen carefully to his conscience, but he had too much of a sense of optimism and so didn't internalize the worry. Who knows? In the end, whatever the reason, he pushed for Challenger to launch.

We're looking for whether someone is empirically willing to make a decision that's unpopular but right, whatever the reason. If they did something like McDonald did, where they were under pressure (including career pressure) to do something, they refuse to do it, and the data eventually shows they had good reason for it, then you've got some data. If they do like his colleague Bob Ebeling did and they write a memo to upper management because they don't feel their direct management is taking concerns seriously, you've got some data, too.

What I'm saying is that, if the person you're considering promoting has never faced a hard decision, and you're promoting them because they had the good fortune to face years of easy decisions through which they could do high-quality work, you know you don't have any data. I agree that it's hard to get the data (and there are obvious problems with that metric turning into a target), but if you don't even try, you're certainly not going to succeed.

All the engineering process in the world will not save you if your hiring and promotion processes incentivize the wrong things. Hence my question: did NASA have a process for deciding that Mulloy and Hardy were good at making life-or-death decisions, or did it simply have a process that determined that they were good engineers?