[scarmig]

You're using a n̶o̶n̶s̶t̶a̶n̶d̶a̶r̶d̶ different sense of the term reproducible. Just to drive the point home, it wouldn't make sense to talk about a reproducibility crisis if having data being consistent across different experiments conducted by the same methodology with different researchers wasn't a key component of reproducibility.

ETA: I encourage the interested to read https://plato.stanford.edu/entries/scientific-reproducibilit... which delves into these semantic issues.

[fastball]

Depends on the experiment. Oil drop is based around something we "know" exists (the charge of an electron) and is just trying to measure it. Measuring a fundamental value is a very different kind of experiment than trying to determine if something exists at all in a wildly multi-variate system (most of the research suffering from reproducibility issues).

Not every experiment needs to be reproducible in exactly the same way, just like not every study needs to be double-blind. You need to interrogate the reason the experiment exists in the first place.

I guess another way of saying it is this: even though Millikan's actual final result is not reproducible because he fudged his numbers, the scientific method employed in the experiment is valid, which is really all you need in the case of that experiment.

The problem with medicine / psychology / other less "hard" research is that in many instances it doesn't matter if the method is reproducible if the results are not. If the goal is to show that eating pancakes cause depression the result is actually all that matters.

Thanks for the link, I will give it a read.

[throwaway2245]

> I encourage the interested to read https://plato.stanford.edu/entries/scientific-reproducibilit...

This link clearly talks about reproducible results, not reproducible data.

Wherever there is some degree of randomness, we would not expect to get the same data, but we would expect to draw the same conclusion.

See also: the Mendelian paradox - it is sometimes argued that Gregor Mendel's results were too perfect, and yet he is honoured as the father of genetics.

[dekhn]

as several of my genetics teachers put it: "wow, mendel was really so lucky that he just randomly managed to pick 7 independently associating traits on different chromosomes" (the molecular biologists in the audience all shook their heads)

[bigbubba]

Physics classrooms around the world have had students replicating this experiment for decades. I think it's not his definition of 'reproducible' that's nonstandard.