| ...well, quite a lot actually, because 20 year olds are more like other humans than different. Humans don't have life stages. We don't wrap ourselves in cocoons and change from grubs into butterflies from ages 16-20. For most of human existence, 20-25 year olds were the substantial power holders. There's a branch of psychology called developmental psychology. It has to do with how humans change over time. If developmental psychologists only studied undergraduates, we wouldn't have a good grasp of the area, but they don't. It's pretty easy to get kids and elderly people to study. It's even pretty easy to get adults to study. It's more expensive than undergraduates, but it's doable. Beyond that, what sort of differences do you expect to see in areas like, say, input attention, working memory, fluid intelligence, social behavior, perception, motor control, etc.? 18-22 year olds are pretty much normal adults in all of those regards. The thing that makes this really insignificant is that we know so little about how minds work. Psychology has only really existed since Skinner and behaviorism made it a real science. If I spent 10 seconds I could think of nice, clever-sounding retorts as to why the perception system of a 22 year old is vastly different from the perception system of a 32 year old, but in reality we know almost nothing and learning anything is good. As Heinlein said, it's wrong to think the world is a sphere, but it's much better than thinking the world is flat. These discussions about replication always sadden me, because they miss the point by so much. Psychology is one of the least respected and yet most vital sciences. The problem is that everyone is a lay expert, because everyone has a mind and thinks they understand how minds work. Psychology has taught us so many valuable, horrible and beautiful things about ourselves. If you're reasonably intelligent, you can come up with reasons not to believe anything. It's easy to discredit things. It's hard to build things. (It's also false that psychology studies are only performed on undergrads, usually undergrads are a good pilot testing base and then you move on to externally recruited populations, unless there's really no reason to do so based on the field.) |
This comment is remarkably troubling to me. There is intrinsic value in replication studies. Showing that an effect does not exist or is far weaker than (or, alternatively, exists and is just as strong as) initially reported is just as much "building" our understanding of scientific truth.
No, scratch that, it is far more important than the original study. The original is more like a sketch, and as the results are confirmed or disconfirmed over the course of many subsequent studies the solid building takes its true form.
These discussions about replication always sadden me, because far too many researchers miss the point of the scientific method.