|
|
|
|
|
by d_burfoot
3125 days ago
|
|
In about 100 years, people will realize that this kind of research doesn't actually work. Here's the problem: the human body is an immensely complex system, with millions of factors influencing its status and well-being. Untangling these factors correctly and producing an accurate and sophisticated statistical theory of the body would require a comparably large number of parameters - on the order of millions or more. Unfortunately, modern medical science relies on low-N observational or clinical trials, with N on the order of hundreds or thousands. In this radically low-data regime it is impossible to justify the use of complex models. If you try to use a complex model, you will just get overfitting. You can use a simple model to avoid overfitting, but there's no reason to believe that a simple model will produce a good approximation of the underlying dynamics. |
|
In terms of caffeine studies, yes- there are definitely thousands of other foods and so-forth that effect the risk of heart disease, cancer, and whatever else they're looking at. There's even things which interact with caffeine specifically to modulate or plausibly even reverse it's effects. All of these things work in egregiously complicated ways. But when I read the study and try to think what it tells me about my own situation, this doesn't matter since I can usually assume that my own exposure to these other factors will be typical compared to that of the study population- thus, I'll tend to respond similarly to caffeine as they did.
This approach is obviously has an abundance of limitations- it only tells me how I'm more likely to respond to caffeine or whatever else, but doesn't give any guarantees. And for someone who is different than the study population- a black woman living in Uganda versus a study done on white male freshmen at Yale, say- the results rapidly become less meaningful. But they do work.