Hacker News new | ask | show | jobs
by dang 4230 days ago
Oh I know. You're preaching to the choir, believe me! But that's not the meme. The meme is invoking it to dismiss a study with no further thought and no specific content.

Small samples get overinterpreted, many published findings are false, etc.—it's all true and the community here is well aware. But it's a gross overreaction to dismiss small-sample experiments wholesale. Even a few seconds' reflection is enough to see that.

For example, assuming this experiment was rigorous, it didn't need more than 16 subjects to find that greater saturated fat in diet doesn't automatically cause greater fat in blood. Additional resources might be better spent on future samples (i.e. replicating the finding by other researchers) than on a larger single sample, which is probably a game of rapidly diminishing returns. And so on.

The point is that HN wants reflective discussions, not reflexive ones. It takes no work and no real thought to pick out one detail that people are currently primed to fuss over and make a post of it. That's not reflection, it's habit, and its payload is not learning, but reinforcement. Reflection requires engaging with the material—this specific material.

There are two ways to do that. One is to dig in and learn the material, think about it, and report your findings to HN. The other is to happen to know something about it in the first place. The first takes work, the second luck. Comments based on neither work nor knowledge are likely not to be substantive. That's why want to avoid generic dismissals as opposed to specific ones.