[xienze]

> I wonder if they actually get meaningful results from MTurk participants

I bet they do. One thing not really touched on in the article is that one of the task qualifiers is “acceptance rate”, i.e., how many of your task submissions were accepted by the person that created the tasks. And that number is usually 99.9% acceptance (of _all_ results you’ve ever submitted) or higher. There is a very strong incentive to not get any kind of rejected submission, because it can quickly tank your MTurk profile and shut off lots of opportunities.