Hacker News new | ask | show | jobs
by srean 4459 days ago
No, grouping over many patients does not eliminate the loop hole at all. The 'coin' was my analogy for the event that a trial was deemed successful (according to some statistical test of hypothesis). If all that I need is to demonstrate is 2 trials that show statistically significant benefits, I can do that expenses permitting (unless the probability of benefit using my candidate drug is exactly 0). The key is that I am allowed unlimited trials where my candidate may not only show no statistically significant benefit but also show worse performance. If only the decision to accept my candidate is based on all the trials together is this hole plugged. My understanding is that FDA does not do this. 2 strikes and you are in, regardless of failure in the other trials.