[mwsherman]

“Epistemology”, he whispered.

Using data is good, but “based on” offers a lot of wiggle room. A 10% increase in CTR is nothing to sneeze at, but it does not answer the question of the best use of your engineers’ (or designers’, or marketers’) time. Should they have instead been working on the thing that has a 50% chance of a 20% improvement? How do we account for all the data we didn’t bring to bear?

The data is small, the interpretation is big.

There is also the problem that philosophers call “regress”, which is that every rational decision has to trace back to a premise that one assumes in. Should we be in the business we are in, compared to all the other potential uses of talent? We can’t know that empirically, at root.

[jes]

+1 for epistemology.