Hacker News new | ask | show | jobs
by executesorder66 3319 days ago
> what you entered, and what should have been entered.

If they knew what should have been entered, why couldn't they just automate the data entry?

1 comments

They extrapolated your accuracy from auditing a relatively small sampling of it, or fed you known-value items and automatically audited them.
Yes, this. I don't know what technique they used. I expect it was known-value variety because they would have better automation in error detection. They may also have used a consensus model, showing work product that really wasn't known value, but was shown to enough different data entry people that the error rate was negated (the error rate requirement was pretty low as I recall) as in a group almost everyone would have done the entry correctly. A third alternative would be to send images that had passed OCR intake for the testing sample.