Hacker News new | ask | show | jobs
by exelius 3684 days ago
That's why it's a canary study. Sure, it looks good, which means it's worth spending the money on a larger study. And yeah, there are lots of people with severe long-term depression, so find some of them, measure their mood over the same time period, and make absolutely sure that the effects you're ascribing to the substance you're testing aren't caused by something else.

You always need a control group because you can't control for every externality over the exact time period the study was conducted. Maybe the weather was especially nice for those 3 months and the control group feels happier as well? We need a way to quantify the results and be able to answer those questions.

Always be careful with the conclusions you draw from studies without control groups. Small studies without control groups are very cheap to run, so you can run the same study 15 times and only report on it when you get the results you're looking for. Not saying that's what happened here, but we have to apply the same standards of proof to all drug studies or else they don't mean anything. The purpose of this study was likely not to prove "hallucinogens can cure depression" but rather "mushrooms are potentially effective and don't appear to have any glaring safety issues".