[frossie]

Then make those people a class of superusers, but do so invisibly.

That actually reminds me of the metacritic scheme. IIRC they take reviews and then (a) translate them into a numeric score according to some method they don't tell you about and (b) weigh each critic by a different weight, of which they don't tell you about.

So your idea is not only interesting, it is probably workable.