|
|
|
|
|
by saosebastiao
3388 days ago
|
|
There is nothing wrong with controls when they're relevant and have a convincing motive behind their inclusion. What's not okay is sequentially trying all of the possible analyses and then stopping the moment you find the exact combination of variables that tells you what you had already assumed to be true. Especially so when simple analyses point to A, and you keep adding new variables until you get to B, which is exactly the case here. That is a very well known abuse of statistics. There is a reason all the well known and popular Information Criterions (which measure model quality) are parameterized by the number of parameters in the model. And while adding control variables isn't per se bad, there are proper precautions to take when doing so, which become exponentially more costly the more you add. Such as segmented sampling, non-linearity transformations, and even controlled experiments. Because these fraudsters have a motive, the model only needs to be as rigorous as necessary to secure their predetermined conclusion. The "keep adding variables" model almost always ends up as a way to lie with statistics. |
|
The horseshoe nature of politics will never cease to amuse me, though; thanks for the example.
Also, if a hypothesis is supported by simple studies but falls apart under more complex ones, it might be too simplistic a hypothesis. Almost as if sexism (and sexism guilt-slinging) wasn't an entirely black-and-white problem. Who'd have thought?