Hacker News new | ask | show | jobs
by shadowgovt 966 days ago
> Transparency into search algos would be better for us all

I think that the jury's out on that topic. Danny's absolutely right in asserting that if the full algo were known, people would write to optimize against the algo, which would defeat the purpose of the algo.

Goodhart's Law is in full effect: “When a measure becomes a target, it ceases to be a good measure."

2 comments

So then the algorithm is crap and that is why they don’t want to show it. If the “full algo” actually prioritizes high quality content we would certainly want everyone to optimize against it!
In general, these models are approximations of an ideal, or some kind of statistical summary across systems that are too complex to completely model.

There's a wide gap between "this algorithm is crap" and "this algorithm stops working if we publish the whole thing publicly and people can explicitly tune data to make number-go-up." That's like claiming a machine learning algorithm is crap because it's possible to build bespoke counter-inputs that maximize badness in the output; that's possible with most ML algorithms, but when someone's not trying to break the machine on purpose, those algorithms often work great.

>but when someone's not trying to break the machine on purpose, those algorithms often work great.

To be fair, that's the exact thing that's wrong here. Creative tools for professionals can assume good faith; no one is trying to break an IDE unless their job is QA for said IDE.

Tools for advertising almost always have bad faith actors, or those actors are the largest presence. The problem becomes untenable when the tool creator has a symbiotic relation with the bad actor.

How about sites that are shown to use SEO or game the algorithm simply cease to exist on Google after a warning period? Change the incentive structure entirely.