[mariusz79]

I've got a simpler solution - scientific paper should not be considered valid until another team replicates the findings. That would quickly get rid of all of the fake results, plus would weed out all of the research that nobody really cares about. Also require that all data is shared, and that until your results are not verified or replicated by a team from another university/country you don't get any more funds.

[Jabbles]

That's not going to work for Astronomy, or results of multi-year studies.

[djokkataja]

Long-term studies or not, it would be useful to have an up-to-date system that clearly indicated whether or not the results of some particular study had been replicated, and how many times they had been replicated if at all, and if there were any conflicting results between studies.

[apathy]

That is what Cochrane does in the UK. And indeed it is great.

[mariusz79]

it will, if you require that the data is shared and can be analyzed by another group. In some cases it will slow down the progress initially, but I think in the long term we would be getting much better results.

[yayday]

You're already moving your goalposts. Your first post said replicates the finding. If I simply post my results and someone else looks at the data and agrees with me then are they really replicating my finding or did they, oh what's the word… peer review my work and agreed?

[Fomite]

I really dislike the idea that "Your code runs on your data" is a form of replication.

[apathy]

It's a minimum standard and one that many published works cannot meet. Universal enforcement of this minimum would itself be a big step forward.

[Fomite]

It is a minimum standard, and a useful one. It mostly annoys me when certain groups of advocates seem to treat it as an end in and of itself, and evidence that something is "repeatable" and will end the problems in obtaining scientific evidence.

I come from a field where something isn't a reproduced until it's also found in an entirely different study on a different population.

[Declanomous]

You can fabricate data nearly as easily as you can fabricate results. It is easier to detect fabricated results from raw data than it is from the final results, but fraud adapts to the methods used to detect it. If you create a new way to detect fraud, fraud will change to avoid that method. Detecting fraud is an arms race.

[apathy]

At some point it becomes easier to just run the damned experiment. Similar to buying a safe based on making its contents not worth the trouble to crack it.

This would be a good first step. "Photoshop for biologists" (as a workshop) is very much a thing.

[Fomite]

What will you do for a study of a national birth cohort?

[alphydan]

Clone them?