|
|
|
|
|
by sowhatquestion
3581 days ago
|
|
Was anyone else disturbed by Strack and Martin's hand-waving away the null replication result? Based on my (admittedly elementary) knowledge of statistics, it seems like 17 replication attempts (samples) whose means are distributed around zero constitute some pretty airtight empirical evidence that there's no inner emotional effect from smiling. How else to read Strack and Martin's complaints but as a kind of special pleading that there was something ineffable about the experiment that the replications missed? Some of their comments gesture in the direction of claiming that replication may be literally impossible. I walked away from this article more convinced than ever that there are big problems with this field of research. And I don't "want" to believe it, either -- I loved Kahneman's Thinking, Fast and Slow. Speaking of which, kudos to Kahneman himself for being (apparently) a more committed empiricist than the other psychologists discussed here. |
|
He started out volunteering to replicate the study and also helping the researchers out a LOT with the experimental re-set-up. Then, when his research is found to be suspect, he starts to throw doubt on it.
Or at least that is what the news article author wrote. Both groups, the new author and the researchers, have incentive to recast what the results of the re-do say. One to sell ads, the other, it is implied, to keep tenure or something, I dunno.
Looking at the redo, there are many good reasons the original researchers have to continue to say their research may be 'good' still. Reasons that the rest of the field entertains and to some extent, believes.
Still, to your point that they may think it is impossible to replicate: That means that no real research occured in the first place. If they are seriously arguing, as the news author implicates, that a research team cannot ever replicate a study, they what they are doing is not 'science' or even psuedoscience. There then is NO POINT to doing any of the research in the first place. If you can't prove an effect, even with large errorbars or something, then you are wasting your life and the money of others.