Hacker News new | ask | show | jobs
by notafraudster 2513 days ago
I'm locked in to my current vendor, but I just wanted to share some of my thoughts about some pain points I saw in your sales pitch.

My experience is that most academics pay less than $6.50 per hour for an initial point of contact. For instance, I am currently fielding a survey (N > 5,000 per week, cross-sectional rather than panel) and we pay about $2 all-in, including the provider's charge, for a survey that's about 20 minutes. We'd fall afoul of your compensation rate pretty substantially. If we wanted to do some panel work and we needed re-contact, we'd definitely ramp up our payment quickly to help avoid attrition, but for the first contact, no.

If we wanted to be paying out your rate, we would almost certainly have to get an additional sponsor partner to piggyback some consumer research on top of our actual treatment. We don't want to do this, it's hard enough dealing with our primary funders. This makes me believe you are mostly targeting commercial / market behavior researchers. That's fine, but the pitch suggests you want academics. For transparency's sake, what is your balance of private and university clients as of today?

Second, even working with large sample providers, their pools are often fairly small. We requested 5,000 unique respondents a week for a year and found our sample provider could only guarantee a 1-2 month lockout. Obviously the effective pool you need to guarantee 5,000 * 52 is enormous and so we were expecting to have to negotiate on lockout, but all of this dances around the fact that sample providers are not transparent about the size of their pool and researchers like us are constantly worried about fraud both by sample providers and by respondents. How large is your pool?

Finally, this kind of quota sampling relies on our ability to weight the sample to the population. Weighting is totally permissible, but responsible weighting is going to cap the weight at the high end -- no one wants the one black Republican to skew the entire poll because they have a 150 weight on their observation (this isn't me getting needlessly political, this happened with the USC tracking poll last election cycle). In my experience, the hardest thing about quota sampling as opposed to the old RDD phone samples 20 years ago is that it's very difficult to get high education / high SES / high income respondents. High income respondents should be 10% of the population and they simply are nowhere near 10% of the pools that you get from standard recruitment methods. Can you speak a bit about a) how you recruit high income people into your pool; and b) what percentage of your pool would be high income (say HHI > $125k a year or so).

Finally, what is your pool attrition rate? If someone takes their first Prolific survey today, what is the probability they will still be taking a survey a year from now? It's nice that you have re-contact as part of your system, but the problem in my experience is not figuring out how to recontact, it's getting people to stay engaged for a long time.

Hope you have good answers to these questions, and that if you do, answering them here will help you get positive exposure from other readers.

2 comments

> In my experience, the hardest thing about quota sampling as opposed to the old RDD phone samples 20 years ago is that it's very difficult to get high education / high SES / high income respondents. High income respondents should be 10% of the population and they simply are nowhere near 10% of the pools that you get from standard recruitment methods. Can you speak a bit about a) how you recruit high income people into your pool; and b) what percentage of your pool would be high income (say HHI > $125k a year or so).

A friend of mine runs into this periodically, with her response pools over-sampling on lower income and older individuals, with a lot of geographic skewing (she does local/regional research, so appropriate sampling at a census block and/or zip code level is needed).

I've worked with her several times to fill that gap, by leveraging Facebook ads for recruitment to balance out the deficiencies in her response pool. Ad cost + incentive tends to work out to the ~$10 range per qualified response. Which is too expensive as a recruitment method for her entire pool, but she's found fantastic to reach the otherwise unreachable demographic gaps she'd have. Different demographics respond better to certain incentive structures and ad copy than others, but in general it's been effective for capturing those hard-to-get groups.

Leveraging the same avenue for re-contact is also handy if your response pool is large enough to create a custom audience to target for follow-up ads. Even out of date contact info can be useful for this. Although your IRB (if relevant) may shut that down if you didn't account for it if the language in your initial contact didn't account for it, since doing this involves disclosing the subject's PII to a third party (Facebook) for creating the custom audience.

> what is your balance of private and university clients as of today?

Our clients are about 80-90% academic, and we find that there’s a strong move within academia towards fair payments. In the long term we think that this will show in the data quality and reliability of samples such that paying fairly will result in the best value. Regarding cost, we're about $2 total for a 15min survey right now.

> How large is your pool?

Lack of transparency about pool size is one of the most frustrating things about online panels. This is one of the reasons why we don’t report our total pool size, but only our ‘active and accessible’ pool (participants who have been active within the past 90days). As a result, you can expect > 50% of the numbers of eligible participants we report to actually take part in the next 24/48hours. We have ~70,000 active participants (20,000+ in the US). I expect we would be able to get a sample of 5,000 people in <48hours, but would only be about to repeat this for about 10weeks with unique participants. Our ‘pool’, as measured by traditional panel providers is approaching 500,000, but we don’t think this is a useful metric as the majority no longer respond to invites.

> a) how you recruit high income people into your pool;

To be honest, we haven’t cracked this nut yet and we expect our pool to be unrepresentative for high income people also right now. Ideas we have to help address this problem are to 1) introduce charitable donations for those who aren’t motivated by cash incentives 2) improve non-financial incentives (e.g. feedback on the impact your data is having) and 3) have highly targeted invites, we hypothesize high earners would be willing to help out if we need someone of their demographics in particular, and if this was communicated well. If you have suggestions, we’re all ears!

> and b) what percentage of your pool would be high income (say HHI > $125k a year or so).

According to self report we have ~2,000 participants from a HHI (>$100k/year on our screener), though it’s possible this suffers from slight inflation and we don’t (yet) have a way to verify income levels.

> Finally, what is your pool attrition rate?

Our annual retention rate is ~40% or so (e.g. if a participant takes part in a study, they’re about ~40% likely to do so again 12months later). There’s a balance between ‘refreshing’ our pool and keeping high engagement, and we’re working on keeping “naivety” high while allowing for studies over a long period!

> have highly targeted invites, we hypothesize high earners would be willing to help out if we need someone of their demographics in particular, and if this was communicated well. If you have suggestions, we’re all ears!

I have had some involvement in running charity events that target high net worth people. You attract them via their ego. Put their name on everything, use their name frequently when speaking with them.

And the kicker - never actually ask them to donate or take the survey or whatever. Just describe what you’re doing and why you’re doing it. They already know you’re talking to them because you want something from them, but if you ask them directly, they’re trained to say no because they have to do it all day. You need to let them make the decision to participate on their own.

That's super interesting, thanks for sharing. "The psychology of high net worth people"... lots to explore there!