[memexy]

I think there is a solution to this problem. If moderator decisions are made and recorded publicly then the data can at least be analyzed objectively. If there is indeed a bias then someone should be able to sit down and do the statistical analysis and show that "Yes, X type of stories / comments are more consistently flagged / removed / downvoted / etc." or "No, there is actually no bias in this instance".

I think there is contention right now because moderator decisions are opaque so people come up with their own narratives. Without actual data there is no way to tell what type of bias exists and why so it's easy to make up a personal narrative that is not backed with any actual data.

User flagging is also currently opaque and a similar argument applies. If I have to provide a reason for why I flagged something and will know that my name will be publicly associated with which items I've flagged then I will be much more careful. Right now, flagging anything is consequence free because it is opaque.

[dang]

I completely understand, believe me I get it—but based on everything I've seen, it's a hopelessly romantic view. If I've learned one thing, it's that people are going to "come up with their own narratives", as you aptly put it, no matter what we do. Adding energy into that would only create more pressure and demand on a system which is maxed out already.

Making this mistake would lead to more argument, not less—the opposite of what was intended. It would simply reproduce the same old arguments at a meta level, giving the fire a whole new dimension of fuel to burn. Worse, it would skew more of HN into flamewars and meta fixation on the site itself, which are the two biggest counterfactors to its intended use.

Such lists would be most attractive to the litigious and bureaucratic sort of user, the kind that produces two or more new objections to every answer you give [1]. That's a kind of DoS attack on moderation resources. Since there are always more of them than of us, it's a thundering herd problem too.

This would turn moderation into even more of a double bind [2] and might even make it impossible, since we function on the edge of the impossible already. Worst of all, it would starve HN of time and energy for making the site better—something that unfortunately is happening already. This is a well-known hard problem with systems like this: a minority of the community consumes a majority of the resources. Really we should be spending those making the site better for its intended use by the majority of its users.

So forgive me, but I think publishing a full moderation log would be a mistake. I'll probably be having nightmares about it tonight.

[1] https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

[2] https://news.ycombinator.com/item?id=23656311

[memexy]

I merely outlined what I would want if I was a moderator. I would rather receive email with statistical analysis than be compared to Hitler and Stalin without any data to back it up. It would be way funnier if someone proved statistically that I was Hitler and Stalin at the same time. They'd have to go through a lot of trouble to actually do that and if they managed to do so then that would be some high art.

Any complaint without data to back it up would be thrown in the trash pile.

In any case. It's a worthwhile experiment to try because it can't make your life worse. I can't really imagine anything worse than being compared to Hitler and Stalin especially if all that person is doing is just venting their anger. I'd want to avoid being the target of that anger and I would require mathematical analysis from anyone that claimed to be justifiably angry to show the actual justification for their anger. Without data you will continue to get hate mail that's nothing more than people making up a story to justify their own anger. And you have already noticed the personal narrative angle so I'm not telling you anything new here. The data takes away the "personal" part of the narrative which I think is an improvement.

[dang]

Alas, there's no way to avoid being the target of that anger. It's inevitable in the system. You're right that one has to develop strategies for managing one's reaction to it. I don't think requiring a mathematical analysis would work in my case. It might not work in any case; I expect most angry people would probably get angrier if told that their anger is invalid because not backed up mathematically, and the dynamics of escalating mass anger could end up destroying the whole system.

There's a deeper issue though. Such an analysis would depend on labeling the data accurately in the first place, and opposing sides would never agree on how to label it. Indeed, they would adjust the labels until the analysis produced what they already 'know' to be the right answer—not because of conscious fraud but simply because the situation seems so obvious to them to begin with. As I said above, the only people motivated enough to work on this would be ones who would never accept any result that didn't reproduce what they already know, or feel they know.

[holler]

Hey dang, first, I appreciate all of your comments in this post and your deep commitment to both HN and the state of online discussion. I'm learning a lot from reading your comments.

I'm curious if given all that you've shared, you think it's even _possible_ to scale a "healthy" discussion site any larger than HN currently is? It's clear that HN's success is in no small part due to the commitment, passion, and active participation of the few moderators. Contrast that with some of the top comments, which describe how toxic Twitter is, and I wonder if there's some sort of limit to effective moderation, or if we just haven't found more scalable solutions to manage millions of humans talking openly online sans toxicity? cheers

[NateEag]

I'm not dang, obviously, but I think it's a testament to his hard work that HN functions even as well as it does.

Most sites its size are far, far worse, I think.

I personally believe that is due to human nature.

I think that is what dang has observed and is trying to articulate - no matter how smart or rigorous or mathematical you are, you still are human and thus subject to the human condition.

One way that manifests is this persuasion that the Other is winning the war (and that there is a war, for that matter).

I take it as almost axiomatic that a site with Twitter's volume cannot be anything but the cesspool it is.

It's too big for a single person to even begin to read a statistically-significant fraction of the content.

That means moderation is a hilariously-stupid concept at that scale. Any team of moderators large enough to do the job will itself suffer the fragmentation and conflicts that online forums do, and find itself unable to agree on what the policies should be, let alone how they should be adapted in contentious cases (and by definition, you only need moderation in contentious cases).

[dang]

I agree with a lot of this, but the things you're talking about already apply to HN, so the argument can't really be used to show that a larger site would necessarily fail to work as well as HN (however 'well' that really is—I'm not making any grand claims here).

For example, the human nature you're talking about is by far the strongest force on HN, and the scale (though tiny compared to Twitter or Facebook or Reddit) is already beyond what one would suppose possible for a forum like this.

[NateEag]

Oops - s/adapted/adopted/.

[intended]

Not Dang.

No.

We haven’t really found it before the internet (these problems are endemic to human/sentient nature.)

The internet only makes things industrialized.

There are things you can do, that reduce the number of friction points, thus making it possible to self govern

1) narrow topics/purpose - the closer to an objective science the better.

2) no politics, no religion - as far as possible.

3) topic should not be a static/ largely opinion oriented. More goal driven, with progress milestones easily discussed and queried (lose weight, get healthy, ask artists, learn photoshop.)

4) clear and shareable tests to weed out posers - r/badeconomics, askhistory

5) strong moderation.

6) no to little meta Discussions

7) directed paths for self promotion

8) get lucky and have a topic that attracts polite good faith debaters who can identify and eject bad faith actors (the holy grail.)

Each of these options removes or modulates a source of drama. With enough of them removed, you can still get flame wars, but it will be better than necker having done these before.

[dang]

I don't know. I think it might be on the unlikely side of possible, but I don't have any compelling reasons for saying so. It would require a lot of learning, but it's possible to learn. It's hard and wouldn't happen by default though. You'd be attempting to induce a group into functioning in a way that that no group that large has ever done before.

NateEag makes some good points in the sibling comment. You'd have to create the culture at the level of the moderation team, and that's not easy. The way we approach this work on HN has aspects that reach deep into personal life, in a way that I would not feel comfortable requiring of anybody—nor would it work anyhow. If you tried to build such an organization using any standard corporate approach it would likely be a disaster. But maybe it could be done in a different way, or maybe there is an approach that doesn't resemble how we do it on HN.

Would it be possible with the economics of a startup, where the priority has to be growth and/or monetization? Probably less.

[intended]

Absolutely not.

There are 2 mods running HN. Responding to people is TAXING - as in its hugely costly. And it has some terrible edge cases which destroy the process:

The costly occasions are when you meet people who are either

a) Angry

b) Rule lawyers

c) malignantly motivated

AT this point their goal is to get attention or apply coercive force on the moderation process.

These guys are an existential threat to the conversational process and one of the win conditions is to get people to turn against the moderators.

Social media is a topic that HN gets wrong so regularly, and without recourse to research or analysis so frequently that I would avoid discussing moderation in general here.

The fact is that if people are arguing in good faith, we can have some amount of peace, and even deal with inadvertent faux pas and ignorance, provided you never reach an eternal september scenario.

But bad faith actors make even this scenario impossible.

[dang]

If you know of research or analysis that is essential on this topic, please tell us what it is. I'd like to be sure I'm aware of it, and other readers would surely be interested also.

[intended]

Hmm. Given the broad range of topics "social Media" covers, there are vast numbers of papers on it.

For people who have NEVER thought of social networks and conversations online I find this site to discuss some of the blander but more game theoretic elements of networks/trust and therefore online conversations:

https://ncase.me/crowds/

https://ncase.me/trust/

-----------------

For you guys (HN Mods) I'd bet that you in particular are abreast of stuff.

- I'd ask if you have heard/seen Civil Servant, by Nathan Matias - its a system to do experiments on forums and test the results (see if there is a measurable change on user behavior)

https://natematias.com/ - Civil Servant, Professor Cornell. He probably has an account here

https://civilservant.io/moderation_experiment_r_science_rule...

- Books: Custodians of the internet.

------

Going through some of the papers I have stocked away, sadly in no sane order. I can't say if they are classic papers, you may have better.

- Policy/law Paper: Georgetown law, Regulating Online Content Moderation. https://www.law.georgetown.edu/georgetown-law-journal/wp-con...

- NBER paper on polarization - https://www.nber.org/papers/w23258, I disagreed/was surprised by the conclusion. America centric.

- Homophily and minority-group size explain perception biases in social networks, https://www.nature.com/articles/s41562-019-0677-4

- The spreading of misinformation online: https://www.pnas.org/content/113/3/554.full

- The Uni of Alabama has a reddit research group, - https://arrg.ua.edu/research.html, they have 2 papers. One of which explores the effect of a sudden influx of new users on r/2xchromosomes. https://firstmonday.org/ojs/index.php/fm/article/view/10143/...

-policy: OFCOM (UK) has a policy paper on using AI for moderation https://www.ofcom.org.uk/__data/assets/pdf_file/0028/157249/...

- Algorithmic content moderation: Technical and political challenges in the automation of platform governance - https://journals.sagepub.com/doi/10.1177/2053951719897945

- The Web Centipede: Understanding How Web Communities Influence Each Other Through the Lens of Mainstream and Alternative News Sources

- Community Interaction and Conflict on the Web,

- You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech

Papers I have to read myself,

- Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. https://shagunjhaver.com/files/research/jhaver-2019-transpar...

- Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms: https://journals.sagepub.com/doi/abs/10.1177/146144481877305... (I need to read that paper, but I expect it to be a good foundation of knowledge and examples)

Other stuff:

- The turing institute talked about Moderators being key workers during COVID - https://www.turing.ac.uk/blog/why-content-moderators-should-...

[holler]

Hey really big thank you for posting this! I'm working on a new discussion site and so much of this is pertinent. I may return with some follow-up commentary once I've read through some of it, thank you.

[intended]

NP. If you find any interesting papers, do share.

[intended]

What papers/articles/sources do you guys read?

[pmiller2]

Not just made and recorded publicly, but easily searchable and aggregated.

[memexy]

Yes. That's what I mean. If there is an API then we can use mathematical models to answer questions about bias or lack thereof.

I also don't think that it's possible to have any forum without bias so the data I'm certain will indicate bias but at least it will be transparent and obvious so people can point to actual data to make their case one way or the other. It's hard to improve a situation if there is no data to point to and argue about. Without data people just tell stories about whatever makes the most sense from whatever sparse data they have managed to reverse engineer from personal observations.