Hacker News new | ask | show | jobs
by titzer 95 days ago
Not I didn't say that it isn't real, I just said it's not that rampant, and I was referring to the egregious examples in the article and the anecdote. But it's a sliding scale and being selective in presenting research results is a gray area that requires us to think about reproducibility and make sure we have good processes for discouraging, detecting, and correcting those kinds of dishonesty, too.

In my field (programming languages and compilers), conferences have started to adopt artifact submissions which include source and build instructions that are then independently replicated by volunteers who serve on artifact evaluation committees. It's a good step in the right direction.

And I'll also caution, again, that reasoning based on anecdotes can be distorted both ways. A tiny minority of people can claim the sky is falling and make it sound like Science is threatened by crisis. Those voices get amplified by the media and the attention economy and get blown out of proportion. What Science and institutions need is mechanisms that are fair and well-resourced and taken seriously. Those mechanisms and the people who volunteer time and effort to keep them running are the real heroes of Science, and breathless articles and anonymous anecdotes on the internet do not make up an accountability system.

If you see fraud, then REPORT IT to someone who can actually hold them accountable. Unsubstantiated and undirected accusations just spread distrust and do not increase accountability.

1 comments

>And I'll also caution, again, that reasoning based on anecdotes can be distorted both ways...

I will go further and say that if you can clearly see how the incentives are aligned, even anecdotes are not necessary.

>If you see fraud, then REPORT IT to someone who can actually hold them accountable. Unsubstantiated and undirected accusations just spread distrust and do not increase accountability.

Mmmm..are you..for real? I mentioned incentives just above, so let us look at it. What is the incentive of this "person who can hold them accountable"? Do they really want to cut down the "output" of the institution by insisting on 100% honest? Do they really want to lose to competition which might allow such practices?

I think not. I think if this is reported, chances that the report will sit in some shelves or end up in some dust bin doing nothing. And the person who report it would suffer one way or the other.

Also: https://gwern.net/doc/sociology/2003-ashforth.pdf

>What Science and institutions need is mechanisms...

Na, "Science" and "Scientists" needs funding. End of story.