[michaelt]

Running your intelligence study in the college's psychology building, paying participants in course credits?

Calling Raven's Progressive Matrices, a measure of "reasoning about novel problems" when it's far from novel in psychology, and most of your test subjects are psychology students?

[bitshiftfaced]

I bet computer science majors have more of an "unfair" advantage than psych majors. It was hard not to notice how many of the patterns match bit manipulation rules such as not and xor.

[Y_Y]

See also: https://rationalwiki.org/wiki/WEIRD

By the way, I think they mean that Raven's Matrices test (somehow) for an ability to reason about problems that are new to the test subject, not that the test itself is new.