|
|
|
|
|
by SeanLuke
3435 days ago
|
|
> where they discarded human losses on time. This stinks of p-value hunting. I can only imagine the study went like this. They did all these tests and then found that there were no statistically significant improvements after using these drugs. So they said to themselves, how can we tweak the parameters so as to get something publishable? Sure, let's eliminate an entire class of games where our control group does better than the test subjects. Problem is, the most likely explanation for this is that people on these drugs spend more time thinking, and longer think time naturally is correlated with better results. But that's not how chess is played, else we'd all spend five hours on each move. Chess is about bounded rationality. As a result it looks to me that that they biased the results as to naturally achieve a desired effect. |
|
Without any other tools (as in, pencil and paper to note conclusions), do you really think you could make a more effective move given five hours?
I mean - if the conclusion of the study is actually that use of drugs gave players a larger personal time bounds within which to think up a move, that's still significant.
I don't know about you, but my #1 blocker for productivity is how long I can actually concentrate on something. If a drug lets me focus for 10% longer, even if it doesn't improve my capabilities while focusing, that's still huge.
Edit: But you're not wrong, it does stink of p-value hunting. On the other hand, if your experiment is expecting one correlation, and instead you find another... then the p-value hunting was the correct move...?