[biztos]

I like this idea! And not only because I have a long-running art project called This Like That.

But I'm not sure about using Mechanical Turk. If the goal is to have unbiased opinions, is that a good place to source them?

I would assume MT participants are trying to complete tasks as fast as possible. If I'm on MT and you ask me "A or B?" my incentive is to give you an immediate answer. I have no incentive to align that answer with my actual opinion.

Also I wouldn't expect MT to give me a particularly random sample. I mean, if I'm wondering how my B2B SAAS logo is perceived, is an answer from MT going to overlap much with the opinions of my target audience?

It seems like a fun thing to try as a toy, like rolling dice only with humans. I'm just not sure I'd use it for any question I really cared about.