Hacker News new | ask | show | jobs
by o11c 740 days ago
> discovery of what is truly high quality

Sometimes nobody really tries. It doesn't help that there are a lot of perverse incentive systems out there. I'm approaching this from mostly an Internet-centric perspective:

One observation I've made is that any story I first see by advertising is probably bad, even if I later see it elsewhere - if it were actually any good, I would've seen it in one of the non-advertising-based mechanisms first. But sites have a strong incentive to promote advertisements to the detriment of quality (and the inaccuracy of "hot" lists).

The "zero-initial-following" problem can be solved by showing each story to a random small subset of active readers (since, as big as the supply of crappy stories is, the demand is always higher). This should be smeared across time-of-day, rather than having a "new" queue subject to gamification. There also needs to be a quick "I'm not interested" feedback, with reasons including "breaks site rules", "bad story", "bad grammar", "bad initial hook", "bad continuation", "I just don't like it" (featured prominently), and "this story is badly tagged" (because both positive and negative tag searches should be the primary way of using any reading site).

Some particular ways that tagging implementations can fail:

* categories and tags are different things, thus a tag is often missing

* no tagging for things like "this a fanfiction of", "this is translated from", "author is not a native English speaker", ...

* tag names are ambiguous, meaning completely different things in different contexts

* tag names are contextual, providing a different shade of meaning depending on other tags

* tags are not prominently displayed when actually looking at a work

* user-made tags are permitted, so duplicates and typos are common

* user-made tags are not permitted and essential tags that people wish to search for (or hide) are missing

* hierarchial (DAG, not tree) tags are not supported, thus a tag is often missing (or if present the list takes up too much space)

* no way to specify tag degree (does this just show up in the background, or is it the focus of the work?)

* number of tags is artificially limited to a very small number

* tag is applied but applicable content doesn't appear yet (mostly relevant for when published serially)

Obviously with outright malicious actors, simply fixing these won't fix everything, but they are absolutely needed to function at scale for the honest actors.

1 comments

> One observation I've made is that any story I first see by advertising is probably bad, even if I later see it elsewhere - if it were actually any good, I would've seen it in one of the non-advertising-based mechanisms first

A similar observation I've been finding lately is that if something is highly rated by critics and lowly rated by audiences, it probably sucks

I think the current batch of book/movie/game critics out there writing reviews are largely out of touch with what many people enjoy. They don't write useful reviews for consumers anymore

There's always accusations of review bombing being the culprit of such skewed scores, but even after sites claim they've culled all of the bad faith reviews, the ratio almost always still exists

>A similar observation I've been finding lately is that if something is highly rated by critics and lowly rated by audiences, it probably sucks

Perhaps there is less skew today given that film critics are probably less a high-brow big city newspaper thing overall. But certainly I wouldn't expect the average Friday night young cinema-goer to have the same tastes as the film critic for the New York Times.

I would expect the New York Times film reviewer to be able to deliver a review that would give the average Friday night young cinema goer a good idea if a film is worth their time, even if they aren't a film snob

From my readings of many film reviews lately, a lot of them really talk down towards people who are not as into cinema as they are

There certainly are review-bombing campaigns, which can be known with certainty when caught at the same time and from the same source as review-boosting campaigns.

Most bad reviews are well-deserved, even if they make the author feel bad. In particular, "people shouldn't downvote if they've only read 5 chapters" is an invalid complaint - as an author, your duty is to write a strong start! (I suspect some of these are actually tagging/description failures, but that's also the author's responsibility)