Hacker News new | ask | show | jobs
by TomHenderson3 450 days ago
They are asking beginners in both the control and test arm, so it sounds like they have "proven" something (or at least given good evidence).
1 comments

This is something that can be heavily skewed by the small N. If the people in both groups happen to closely match in their distributions of accuracy for this self-assessment then this would be correct. Larger N would make both groups much more likely to match the real distribution, which would in turn make them more likely to match each other.
Added to that, creatine could influence how close you feel to failure. I'd like to see some data, for participants training until failure. That would still be somewhat subjective, but i'd argue, less so.
That is clearly something that they would be finding given the design of their experiment, no?
Can you explain the stats to give me the proper N for when this experiment would be properly powered?