[byrneseyeview]

They're talking about the top fifty such phrases. It seems unlikely that there would be a demographic group that is proportionately less likely to use any arbitrary phrase. The only possibility is for a group's phrase usage to be statistically indistinguishable from the average.

Fortunately, we can perform a sanity check: read some of the phrases to someone, and ask that person which group they think the phrases came from. I bet people will guess with high enough accuracy to establish that it's nonrandom.

[reader5000]

I'm not saying the results were random. I'm saying they're not really allowing for a "confidence interval" in how many more times a certain group uses a phrase than average. For example if black men use "soul food" 30x greater than average that seems like a solid result. But if it's only 1.01x more than average that seems like noise.

[mshron]

Max Shron, OkCupid Data Scientist here.

In an older version of the post, we did have the actual numbers, but they didn't seem to add much. Black women use "soul food" 20 times (!) more frequently than the site-wide average; for black men, "soul food" is 11 times as frequent.

AFAIK, nothing we put up for this article is less than twice as frequent for that group as it is for the general (OkC) population.

[untamedmedley]

RE: Soul Food, one of the comments on the OKC site mentioned that Soul Food applies not only to a style of cuisine, but also to a movie and subsequent spin-off series on HBO.

The reason it pops up so frequently is because the movie is hailed within the black community as one of the few Hollywood productions that presents black people as multi-dimensional humans that deal with a number of problems related to race, class, and life in general. It's a classic.

[moultano]

Just for completeness, you guys should compute g-test statistics for this so that the statisticians see something they're used to.

http://en.wikipedia.org/wiki/G-test

[mshron]

I'll check it out. Thanks!

[moultano]

I think it should actually give you better results. It's monotonic in kl divergence, and does a much better job of taking into account how common the feature is rather than just how different it is. You no longer need to do things like throwing out phrases that appear less than x times if you use it.

[reader5000]

Fair enough. OKC should really release an api for people to pull data for their own analyses. Make your data viral!