|
|
|
|
|
by swatcoder
5 days ago
|
|
> Software developers in the US are seriously expensive, using them for data labeling would be a waste of resources. The frontier work is on labeling and training expert content, by experts. It's unglamorous work and almost certainly doesn't warrant FAANG pay, but neither did most of the work that most FAANG engineers were already doing. But it does require competent talent from the expert domain. Like their peer companies, Meta is still sitting on a huge pool of vetted-as-competant workers from the hiring boom and expert AI training is the most ripe business opportunity in a fragile economy where pretty much every comparable opportunity has evaporated. |
|
For a coding agent, for example, there is *very detailed* analysis of the turns and ranking of different portions of the conversation.
Adherence or deviation from specific rules matters. Writing quality matters. Expertise in the topic under discussion matters. Having intuition for the tone and beat of a good conversation matters.
Scoring a 15-20 turn conversation can easily take two and a half hours.
Clicking submit does not mean the author is done. Many annotations will be turned back to them by a reviewer to touch up in some way.
This work can be far more mentally taxing than programming, is measured much more by completions more of a timed exercise than SWE.
FWIW, Meta employees would probably make great coding agent conversation annotators. But it is absolutely not SWE and they won't enjoy it (for long).