Hacker News new | ask | show | jobs
by contact_fusion 3039 days ago
I know this may be perceived as nitpicking, but I am generally annoyed whenever the reproducibility/reliability crisis is referred to as a problem in science, writ large, rather than a specific problem in specific scientific subfields. This seems to be particularly common when the articles are written by practitioners within these subfields, such as neuroscience, biology, or psychology.

There is no reproducibility crisis in my field of science - astrophysics. To back this claim up, I searched at Retraction Watch for any mention of the top tier journals in astronomy & astrophysics - specifically, ApJ [1], MNRAS [2], A&A (none found), Icarus (none found), Nature Astronomy (none found) - and found exactly one correction and one retraction. Now certainly errata are published constantly, and I would be foolish to assume that just because Retraction Watch didn't catch many instances of scientific fraud or abuse within my field, that it practically doesn't exist. But no evidence for a "crisis" seems to exist, at least in my corner of science. Astrophysical research appears to be quite reliable and reproducible. For similar reasons, I haven't heard of a reproducibility crisis in analytical chemistry, or optical physics, or mathematics, to name a few - or, close to the interests of Hacker News, computer science. Feel free to correct me if I'm wrong.

I'm not saying this to bash non-astronomers, or non-physicists, or specifically life scientists. Biologists, neuroscientists, and psychologists are crucial participants in the greater scientific enterprise and their efforts lead more directly to alleviating human suffering than my work ever will. But when talking about reproducibility and reliability problems we cannot conflate different scientific disciplines with vastly different cultures, practices, and norms - a crisis in biology does not imply that physics has one too. Physics may have its own problems, but they aren't the same as the ones in biology.

Witness the rise of groups such as the Flat Earthers, who are rejecting basic scientific knowledge known for literal millenia.(Eratosthenes, anyone?) Or witness the anti-vaxxers, abandoning modern medicine for charlatanry. Pretending science is a monolithic enterprise and abandoning a fine-grained understanding of the validity and power of different types of scientific evidence just gives these movements strength, feeds their delusions, and weakens the prestige of scientists when we do need to stand together.

[1] http://retractionwatch.com/category/by-journal/astrophysical... [2] http://retractionwatch.com/category/by-journal/monthly-notic...