Hacker News new | ask | show | jobs
by swalls 1698 days ago
> Q: Is it true that Delphi is learning moral judgments from Reddit?

> A: No. Delphi is learning moral judgments from people who are carefully qualified on MTurk. Only the situations used in questions are harvested from Reddit, as it is a great source of ethically questionable situations.

MTurk is pretty worthless in these kind of situations. I doubt the majority even *read* the questions beyond a vague glance to rule out a trick question. It's also biasing answers towards cultures that

a) are primarily in places that MTurk pays out

b) are primarily in places where the cost of living is low enough that MTurk can provide a job.

2 comments

It's based on MTurk? That's even more embarrassing than reddit. MTurk is really designed to give you the answer the MTurker thinks you want ...
> Is learning moral judgments from Reddit good?

> It's bad

https://delphi.allenai.org/?a1=Is+learning+moral+judgments+f...

Well, at least it got that right!