Hacker News new | ask | show | jobs
by snewe 5417 days ago
Sounds interesting. Similar to Crowdflower, but with less management on the user end. Crowdflower provides "gold tests" that help filter out mistakes and makes it my go-to source for Turk tasks with a bit too much complexity. Of course, that means I have to manage questions, gold tests and review results. The value proposition here is thus quite appealing. Suppose we wanted to grab information from historic form D's:

http://www.sec.gov/Archives/edgar/vprr/03/9999999997-03-0208...

These older forms lack consistency and would probably require lengthy instructions for data extraction. How do you do quality control?

1 comments

One of the founders here.

We do a number of things to maintain quality. We do managed crowdsourcing, which means we provide support to our crowd. They can ask us when they do not understand a particular task. Also, our crowd is loosely forming a community both online and IRL. So, people help each other.

On top of that we have developed algorithms that check the crowd's answer against each other. Our algorithms also make sure that the right task is routed to the right person.

We also believe in paying our workers fairly. Happy, more productive workers leads to better quality work.

Awesome, sounds like you automated and crowd-sourced quality control. Will definitely check it out.