[nextaccountic]

> How do you derive that something is "below average" or "average" or "above average"?

One technique is RLHF: have an human expert assess it.

[OtomotO]

Mhm, I just wonder how many samples they get and how much time they have to come to the conclusion.

Like a short example is easier to grade, but not in the same ballpark as a whole codebase.