[kozikow]

In my company I have my own image labeling team in Poland and I pay $4 per hour. I can go down to $2.5. Median hourly rate of amazon mechanical turk is supposedly $1.38[1]. My dataset is harder to label than ordinary images, so it takes a few hours to ramp up the labeller. I have been contemplating migrating to mechanical turk for a while. Anyone have some experience to share?

1. http://journals.sagepub.com/doi/full/10.1177/216770261246901...

[IanCal]

Is it a major cost to your business? Would it be a large risk if things went badly?

Also, does your current setup have any problems (perhaps scaling)?

If the answers are no, yes, no then I'd not change a thing.

Otherwise perhaps look at using Turk for labeling and your working crew as reviewers. It may only take a small number of badly labeled images to cost more than you save.

[pranaygupta]

you may want to try out Squadrun. Their quality is pretty high and they are typically faster and cheaper than MT.

https://squadrun.co/