I use to run a lot of tasks on Amazon’s Mechanical Turk and the hardest problem I had was the people I call “Superturkers” who would do a very high volume of work that is just barely acceptable in quality.
On some level they are very hard working and if I banned them it would take longer to get my tasks completed. If they did 5% of the work that they do the low quality wouldn’t bother me because (1) a little of that diluted in the whole is OK and (2) the individuals would not come to my attention.
With some feedback some of those people might get better (I was always open to paying more for quality) but I also didn’t want to get into arguments with those folks.
On some level they are very hard working and if I banned them it would take longer to get my tasks completed. If they did 5% of the work that they do the low quality wouldn’t bother me because (1) a little of that diluted in the whole is OK and (2) the individuals would not come to my attention.
With some feedback some of those people might get better (I was always open to paying more for quality) but I also didn’t want to get into arguments with those folks.