[Palmik]

This is a naive take. How do you think Google collects or collected data for their safe-search classifiers? Now that's a sludge.

Or how do you think Google evaluates search-ranking changes (or gather data for training various ad-ranking & search-ranking models).

[staunton]

I don't know. How do they?

[NavinF]

Their instructions for human raters is public info.

Overview: https://blog.google/products/search/overview-our-rater-guide...

Full PDF: https://static.googleusercontent.com/media/guidelines.raterh...

[pixl97]

I was going to make a joke about all those CAPTCHAs we've solved, but I don't have an answer here.