|
|
|
|
|
|
by philipkglass
806 days ago
|
|
|
Mechanical Turk suffers from coordinated fraud by people who want to be paid for doing a task without actually doing it [1]. The company I work for had to spend more engineering effort on building an internal reviewing-the-reviewers system to make it useful than we spent on the original Mechanical Turk integration. I'm not surprised that Amazon would avoid Mechanical Turk for higher consequence applications. [1] e.g. https://timryan.web.unc.edu/2020/12/22/fraudulent-responses-... |
|
|
We already had a lawyer having case thrown out because he didn’t do the job properly and got hallucinations from LLM.
Mostly because people don’t want to work.