Hacker News new | ask | show | jobs
by kevinalexbrown 3351 days ago
I'm not sure that's true here.

They went further than showing a correlation between two traits. They directly manipulated the pre-alcohol state (alone, or with other crayfish), and measured whether that change outcomes in behavior and neural activity. Presumably they kept everything else the same[0], randomly assigned crayfish to isolation and social environments, and placed them in the same alcohol environment.

Just because the chain of causation is fuzzy doesn't mean A doesn't cause B. Maybe social isolation and alcohol response are trivially connected to something else like movement rate and other variables. That doesn't mean you can't make causal inferences.

[0] I don't know much about crayfish experiments - maybe there's some latent cause like isolated crayfish are handled differently and that causes changes in alcohol-induced behavior and neural activity. I would want to know whether the crayfish showed similar or divergent behavior in an alcohol-free environment. It's possible that alcohol has identical 'gain' on behavior and neural activity, but that still indicates an effect, technically. And nothing is ever 100 percent the same across conditions (this is the fundamental problem with causal analysis) but that's true across every discipline.

If there's an objection to the title, it's that loneliness and social isolation are not the same thing.

1 comments

> Just because the chain of causation isn't clear doesn't mean A doesn't cause B.

Yes, that's true, but science isn't based on what can't be excluded, it's based on what the evidence supports. If this were not true, any claim that couldn't be disproven would ipso facto become true.

Some have said it this way -- to a pseudoscientist, things are assumed to be true until they're disproven. To a scientist, things are assumed to be false until evidence supports them (the null hypothesis).

> That doesn't mean you can't make causal inferences.

Yes, you can do that, but it's not science. In science, it's not about inference, it's about evidence.

Before publication, any sort of speculation is the norm, it's part of the creative process. But when the science gets published and the title contradicts the article, something went wrong.

Except that there is evidence of causation, not just correlation. That is the purpose of performing a rigorously controlled experiment. If all we were looking for was evidence of correlation, that would be unnecessary.
> Except that there is evidence of causation, not just correlation.

In science, addressing causation requires a testable, falsifiable theory. Without a theory -- an explanation -- we can only describe what took place. The authors of the paper freely acknowledge that they don't understand their result in a theoretical sense. But the article's title -- "Drunken crayfish show that loneliness raises alcohol tolerance" -- is perfect nonsense and an embarrassment for a half-dozen reasons.

By the way, the moderators edited the submission's title since I posted this morning. Unfortunately, it seems that New Scientist's editorial standards aren't as high as those at HN.

The theory in this case is "Isolations affects alcohol tolerance in crayfish". This is falsifiable and testable. A theory does not need to contain an explanation to be a valid scientific theory.

The experiment that was done is evidence in favor of this theory. It is not conclusive, because it is only one experiment, but it does suggest a causal relationship, and not just a correlation.

> The theory in this case is "Isolations affects alcohol tolerance in crayfish".

That is not a theory, it's a statement about an observation -- it describes, it doesn't explain. Theories explain observations.

> A theory does not need to contain an explanation to be a valid scientific theory.

A scientific theory is an explanation[1]. That's how it's defined. A description cannot be a theory because it doesn't say why the result took place, only that it did.

If I say, “The night sky is filled with tiny points of light,” I've offered a description. Another observer might contradict my description, for example by emerging from his cave on an overcast night and not seeing any points of light, but that contradicting observation can itself be contradicted on the next clear night, without any chance for resolution (so a contradiction is not a falsification). Apart from being shallow, inconclusive and trivial, this process is not science.

If instead I say, “Those points of light are distant thermonuclear furnaces like our sun,” I've offered an explanation, one that makes predictions about phenomena not yet observed and that's falsifiable by empirical test. On the basis of this explanation we might build a small-scale star (a fusion reactor) to see if our experiment shows any similarity to the spectra and behavior of stars. This deep explanation represents a theoretical claim that's linked to other areas of human knowledge, predicts phenomena not yet observed and is conclusively falsifiable by comparison with reality (our fusion reactor might fail to imitate the stars). It's science.

1. https://en.wikipedia.org/wiki/Scientific_theory

Quote: "A scientific theory is an explanation of some aspect of the natural world that can, in accordance with the scientific method, be repeatedly tested, using a predefined protocol of observations and experiments. Established scientific theories have withstood rigorous scrutiny and are a comprehensive form of scientific knowledge." (emphasis added)

"Isolation affects alcohol tolerance in crayfish" is not just an observation. An observation would be "Crayfish #5 has behavior X".

You are conflating two different definitions of explain. It is possible to explain what is happening without explaining how. It is possible to know that A causes B without knowing why (This is purpose of the scientific method). If it were actually impossible to have evidence that something is true without knowing why it is true, than it would be impossible to have evidence of anything at all. You could invalidate any knowledge by just asking "why", because there is always another "why". To give an example, we know that mass causes gravitational attraction even though we don't fully understand the mechanism that causes it.

"X causes Y" is separate and can be proven separately from "X causes Y by Z mechanism". The former seems to have been proven here.
> "X causes Y" is separate and can be proven separately from "X causes Y by Z mechanism". The former seems to have been proven here.

The experimenters changed the environment and noted a change in behavior. This isn't enough to be able to say which aspect of the change induced the behavioral change, in particular because the study isn't testing a theory, or a cause. It's testing an effect -- the outcome of an environmental change.

This is something that Richard P. Feynman described in some detail in his now-famous talk entitled "Cargo Cult Science." He describes a number of social science studies that went off the rails because the experimenters were too quick to draw conclusions based on experiments the investigators didn't really understand. As a counterpoint he describes one outstanding experiment in which the experimenter went to great lengths to find out why a certain effect took place. Feynman's point was that science requires great care that we don't draw conclusions not sufficiently informed by skepticism.

http://calteches.library.caltech.edu/51/2/CargoCult.htm

To summarize, to be able to claim a cause -- effect relationship, we would need to understand the cause -- we would need a falsifiable theory about why a change took place, not merely that there was a change.

So science is incapable of saying, for example, that raising my cup to my lips allows me to drink coffee, since we can't yet describe that from quantum phenomena upwards? What a pointless method of study.
> What a pointless method of study.

A pointless method of study that's responsible for building the world you see around you, including the computer you're using for this conversation.

In science the problem is not getting the answers, it's being sufficiently skeptical of those who think they already have the answers.

> ... since we can't yet describe that from quantum phenomena upwards?

But that's not true -- we can describe it, but we can't explain it. Literature describes, science explains. Good science resists premature explanation.

But the evidence supports the idea that social isolation induces measurable changes in behavior and neural activity.

And you can definitely make causal inferences if you don't understand everything. If that weren't true, you wouldn't be able to infer that moving your arm makes the coffee cup in your hand move unless you knew everything about physics.

> But the evidence supports the idea that social isolation induces measurable changes in behavior and neural activity.

The experiment showed a change in behavior resulting from a change in environment. There's no cause proposed that rises above opinion and conjecture. To be able to say why the change took place, we would need a falsifiable theory that offers an explanation, not just a description, which is all this study provides.

Further reading: http://calteches.library.caltech.edu/51/2/CargoCult.htm