Hacker News new | ask | show | jobs
by andyjohnson0 4249 days ago
Apart from the small sample size, if they collected data by mechnical turk then I wonder what sort of biases that introduces? In the paper you linked, Frances and Mialon state:

"Samples of mTurk workers have been found to be more representative of the US population than in-person convenience samples, standard internet samples, and typical college samples"

I am somewhat sceptical of this, and there seems to be some evidence to back-up my scepticism [1][2][3]. In particular, [2] states:

"In sum, the MTurk sample is younger, more male, poorer, and more highly educated than Americans generally. This matches the image of who you might think would be online doing computer tasks for a small amount of money."

Which are some of the factors that the marriage study itself seeks to examine. This looks like lazy data collection methodology to me.

[1] http://www.culturalcognition.net/blog/2013/7/10/fooled-twice...

[2] http://themonkeycage.org/2012/12/19/how-representative-are-a...

[3] http://www.behind-the-enemy-lines.com/2010/03/new-demographi...

1 comments

It merely says that it's more representative than the other groups, not that it's particularly representative. For instance college samples are massively unrepresentative (younger, smarter, probably wealthier than average).

Essentially it's just a more representative sample than these other horribly unrepresentative samples he's listing.