[jdietrich]

>First, it appears to imply that such a probabilistic inductive approach to science would be free of any philosophical baggage or assumptions

I'm arguing that philosophical baggage is irrelevant to the current practice of science, because the overwhelming majority of published papers have serious and obvious methodological deficiencies that we have collectively agreed to ignore. Science as practised today is a desperate struggle to demonstrate something (p ≤ 0.05) by any means necessary. Established statistical methods have become a means to conceal rather than illuminate. This isn't the fault of individual working scientists, but the fault of the basic information architecture of science and a ritualistic, cargo-cult approach to understanding data. Bayes theorem probably isn't all we need, but it is all we need to spark a scientific renaissance if only we would use the damned thing.

[RoyalHenOil]

Something to keep in mind is that science is not only practiced in cutthroat academic institutions. Arguably most of the science being practiced today is happening in R&D departments across the world, where there is a strong financial incentive to beware of false positives due to the expense of policy changes.

I worked in private agricultural research for many years, and the issues you describe here did not apply to us. A single instance of statistical significance was insufficient to make any assumptions or adjust any policies. Of course we would present those results if we got them, but nobody was getting excited about it until we got the same results consistently several more times, in several different locations, with several different research teams. Being the first to get a positive result was no more meaningful that being the 10th to get a positive result. Promotions were based on your ability to design and conduct solid research, regardless of the outcome.