pith. sign in

arxiv: 1906.11932 · v1 · pith:J35OZD4Vnew · submitted 2019-06-27 · 💻 cs.SI · cs.CY

To Act or React: Investigating Proactive Strategies For Online Community Moderation

Pith reviewed 2026-05-25 13:33 UTC · model grok-4.3

classification 💻 cs.SI cs.CY
keywords proactive moderationreddit communitieshateful discourse predictioncommunity evolutionmachine learning classificationbans and quarantinesonline community behavior
0
0 comments X

The pith

Reddit communities can be predicted to evolve into hateful or bannable ones months ahead using signals from past banned groups.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper tests whether administrators can spot communities likely to produce content that leads to bans before the problems appear. It tracks how groups change in their members and discussion topics and finds these shifts often point to future trouble well in advance. This would let a small staff focus monitoring on fewer targets and supply data to support any later decisions. The work also measures how taking part in risky communities affects users and how bans or quarantines change behavior afterward. If the patterns hold, moderation moves from reacting after harm occurs to acting on early warnings.

Core claim

Communities are constantly evolving in their user base and topics of discourse and that evolution into hateful or dangerous communities can often be predicted months ahead of time, making proactive moderation feasible. Explainable machine learning identifies the strongest predictors of this evolution and shows the impact of participation in such communities along with the effects of bans and quarantines.

What carries the argument

Machine learning models that classify communities by their evolution in user base and topics, trained on features from previously banned groups and paired with explainable techniques to rank predictors.

If this is right

  • Administrators can focus limited attention on a smaller set of communities likely to need intervention.
  • Actions such as bans or quarantines gain backing from measurable community characteristics rather than external pressure alone.
  • The traits that mark at-risk communities become visible, guiding where to watch most closely.
  • Bans and quarantines produce measurable shifts in how members behave after the action.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The same early-signal approach could be tested on platforms with similar community structures to see if the prediction window stays months long.
  • If the model flags groups accurately, it opens the possibility of lighter interventions before full bans become necessary.
  • Repeated testing on newly formed communities would show whether the patterns remain stable as platform rules or user habits shift.

Load-bearing premise

The signals seen in communities that were already banned will appear early and consistently in communities that have not yet been banned.

What would settle it

New communities that later receive bans but lack the same early changes in membership or topics that the model relies on, or fresh data where the trained model fails to flag at-risk groups before they are banned.

Figures

Figures reproduced from arXiv: 1906.11932 by Fareed Zaffar, Hussam Habib, Maaz Bin Musa, Rishab Nithyanand.

Figure 1
Figure 1. Figure 1: An snippet of a larger dendrogram obtained by hierar￾chical clustering on topic vectors. LDA topics are associated with each cluster. in previous work seeking to uncover the commonalities be￾tween r/The_Donald and other communities [57] using vec￾tor algebra. 3.1.2 How do we compute the evolutionary distance between two subreddit states? Given succinct vector representations of subreddit states, we now nee… view at source ↗
Figure 2
Figure 2. Figure 2: Characteristics of topic and active user base evolution for subreddits in DA, DB, DH , and DR. Figures (a) and (b) show the distribution of the mean magnitudes of topic and active user base evolution per month for subreddits in different categories. Figures (c) and (d) show the average magnitude of topic and active user base evolution as a function of subreddit age. The maximum lifetime of a subreddit is t… view at source ↗
Figure 3
Figure 3. Figure 3: The impact of joining events on user behavior. Month “0” represents the month of the join event. (a) Metric: Offensiveness rate. Event: Banning dangerous sub￾reddit (DB). (b) Metric: Rate of participa￾tion in hate communities (DH ). Event: Banning dangerous sub￾reddit (DB). (c) Metric: Offensiveness rate. Event: Quarantining dangerous subreddit (DB). (d) Metric: Rate of participa￾tion in hateful communitie… view at source ↗
Figure 4
Figure 4. Figure 4: The impact of ban and quarantine events on user behavior. Month “0” represents the month of the event. (rather than predicting) user interaction evolution in differ￾ent communities. Kumar et al. [49] studied the Flickr and Yahoo! 360 communities to understand the role of specific users in community growth. They found that a small number of key users are responsible for expanding a community and in the abse… view at source ↗
read the original abstract

Reddit administrators have generally struggled to prevent or contain such discourse for several reasons including: (1) the inability for a handful of human administrators to track and react to millions of posts and comments per day and (2) fear of backlash as a consequence of administrative decisions to ban or quarantine hateful communities. Consequently, as shown in our background research, administrative actions (community bans and quarantines) are often taken in reaction to media pressure following offensive discourse within a community spilling into the real world with serious consequences. In this paper, we investigate the feasibility of proactive moderation on Reddit -- i.e., proactively identifying communities at risk of committing offenses that previously resulted in bans for other communities. Proactive moderation strategies show promise for two reasons: (1) they have potential to narrow down the communities that administrators need to monitor for hateful content and (2) they give administrators a scientific rationale to back their administrative decisions and interventions. Our work shows that communities are constantly evolving in their user base and topics of discourse and that evolution into hateful or dangerous (i.e., considered bannable by Reddit administrators) communities can often be predicted months ahead of time. This makes proactive moderation feasible. Further, we leverage explainable machine learning to help identify the strongest predictors of evolution into dangerous communities. This provides administrators with insights into the characteristics of communities at risk becoming dangerous or hateful. Finally, we investigate, at scale, the impact of participation in hateful and dangerous subreddits and the effectiveness of community bans and quarantines on the behavior of members of these communities.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper claims that Reddit communities evolve in user base and topics in ways that allow machine learning models to predict, months in advance, which ones will become hateful or dangerous enough to warrant administrative bans or quarantines. It asserts that this makes proactive moderation feasible, employs explainable ML to surface the strongest predictors, and examines at scale how participation in such communities and subsequent bans affect member behavior.

Significance. If the central prediction result survives proper temporal validation, the work would offer a concrete, data-driven path toward shifting moderation from reactive (post-spillover) to proactive, while the explainable-ML component supplies interpretable signals that could inform administrator decisions. The large-scale empirical analysis of ban/quarantine effects is a secondary strength that adds to the literature on moderation efficacy.

major comments (2)
  1. [Methods] Methods section (prediction pipeline): the manuscript does not describe whether training and testing respect strict temporal ordering (e.g., forward-chaining or time-respecting splits that train only on data available before each community's ban date). Because labels are derived from eventual ban status, any leakage of post-threshold features would render the reported 'months ahead' lead time non-prospective and undermine the proactive-moderation claim.
  2. [Results] Results (prediction performance): the evaluation reports aggregate accuracy or AUC but does not break performance down by prediction horizon (e.g., 1-month vs. 6-month lead time) or provide precision-recall curves at operationally relevant thresholds; without these, it is impossible to judge whether the model supplies actionable early warning or merely detects communities already close to the ban threshold.
minor comments (2)
  1. [Abstract] The abstract states that 'explainable machine learning' is used but does not name the technique (SHAP, LIME, etc.) or the base classifier; this detail should appear in the methods for reproducibility.
  2. [Figures] Figure captions for the evolution timelines and feature-importance plots should explicitly state the time window over which features are computed relative to the ban date.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their constructive feedback. We address each major comment below and will revise the manuscript to strengthen the description of our methods and results.

read point-by-point responses
  1. Referee: [Methods] Methods section (prediction pipeline): the manuscript does not describe whether training and testing respect strict temporal ordering (e.g., forward-chaining or time-respecting splits that train only on data available before each community's ban date). Because labels are derived from eventual ban status, any leakage of post-threshold features would render the reported 'months ahead' lead time non-prospective and undermine the proactive-moderation claim.

    Authors: We agree that explicit documentation of temporal validation is required. Our pipeline used only pre-prediction-date features for each community and employed forward-chaining splits on historical data to avoid leakage. We will revise the Methods section to detail this procedure, including confirmation that no post-ban or post-threshold information entered the models, along with a diagram of the time-respecting workflow. revision: yes

  2. Referee: [Results] Results (prediction performance): the evaluation reports aggregate accuracy or AUC but does not break performance down by prediction horizon (e.g., 1-month vs. 6-month lead time) or provide precision-recall curves at operationally relevant thresholds; without these, it is impossible to judge whether the model supplies actionable early warning or merely detects communities already close to the ban threshold.

    Authors: We concur that horizon-specific metrics and precision-recall analysis would better demonstrate proactive value. We will add breakdowns of performance (AUC, F1) at 1-, 3-, and 6-month horizons and include precision-recall curves at varying decision thresholds in the revised Results section and supplementary material. revision: yes

Circularity Check

0 steps flagged

No circularity: empirical ML prediction on temporal community features stands independently of inputs

full rationale

The paper frames its core result as an ML-based prediction task that extracts features from community evolution (user base, topics) prior to ban events and forecasts future risk. No equations, self-citations, or ansatzes are shown that would make the reported lead-time predictions equivalent to the training labels or fitted parameters by construction. The setup is a standard supervised learning pipeline on historical data with external labels (bans), not a renaming or self-referential definition. This matches the default expectation of a non-circular empirical study.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

The abstract does not detail any free parameters, axioms, or invented entities; the approach appears to rely on standard supervised machine learning applied to community evolution data.

pith-pipeline@v0.9.0 · 5820 in / 968 out tokens · 28679 ms · 2026-05-25T13:33:51.681689+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Leveraging AI for Direct Bystander Intervention Against Cyberbullying

    cs.HC 2026-04 unverdicted novelty 6.0

    EmojiGen uses emoji selections to generate AI responses that increase direct bystander interventions against cyberbullying and raise defending self-efficacy in a controlled experiment.

Reference graph

Works this paper leans on

88 extracted references · 88 canonical work pages · cited by 1 Pith paper · 1 internal anchor

  1. [1]

    http://www.slate.com/articles/technology/technology/2014/10/ reddit_scandals_does_the_site_have_a_transparency_problem.html

    2014. http://www.slate.com/articles/technology/technology/2014/10/ reddit_scandals_does_the_site_have_a_transparency_problem.html. Accessed: 2019-04-19

  2. [2]

    Time to talk : announcements

    2014. Time to talk : announcements. https://www.reddit.com/r/announc ements/comments/2fpdax/time_to_talk/

  3. [3]

    From 1 to 9,000 communities, now taking steps to grow red- dit to 90,000 communities (and beyond!) : announcements

    2015. From 1 to 9,000 communities, now taking steps to grow red- dit to 90,000 communities (and beyond!) : announcements. https: //www.reddit.com/r/announcements/comments/2x0g9v/from_1_to_9000_ communities_now_taking_steps_to/

  4. [4]

    Update on site-wide rules regarding violent content : mod- news

    2017. Update on site-wide rules regarding violent content : mod- news. https://www.reddit.com/r/modnews/comments/78p7bz/update_o n_sitewide_rules_regarding_violent_content/

  5. [5]

    Update on site-wide rules regarding violent content : modnews

    2017. Update on site-wide rules regarding violent content : modnews. https://www.reddit.com/r/modnews/comments/78p7bz/update_on_site wide_rules_regarding_violent_content/?st=j9sclyhf&sh=83ab2970

  6. [6]

    Why Reddit won’t ban The_Donald - Vox

    2017. Why Reddit won’t ban The_Donald - Vox. Vox. https: //www.vox.com/culture/2017/11/13/16624688/reddit-bans-incel s-the-donald-controversy

  7. [7]

    New addition to site-wide rules regarding the use of Reddit to conduct transactions : announcements

    2018. New addition to site-wide rules regarding the use of Reddit to conduct transactions : announcements. https://www.reddit.com/r/announcements /comments/863xcj/new_addition_to_sitewide_rules_regarding_the_us e/

  8. [8]

    Revamping the Quarantine Function : announcements

    2018. Revamping the Quarantine Function : announcements. https: //www.reddit.com/r/announcements/comments/9jf8nh/revamping_the_ quarantine_function/

  9. [9]

    Update on site-wide rules regarding involuntary pornogra- phy and the sexualization of minors : announcements

    2018. Update on site-wide rules regarding involuntary pornogra- phy and the sexualization of minors : announcements. https: //www.reddit.com/r/announcements/comments/7vxzrb/update_on_s itewide_rules_regarding_involuntary/

  10. [10]

    https://bigquery.cloud.google.com/dataset/fh-bigquery:redd it_posts

    2019. https://bigquery.cloud.google.com/dataset/fh-bigquery:redd it_posts. Accessed: 2019-04-19

  11. [11]

    https://bigquery.cloud.google.com/dataset/fh-bigquery:redd it_comments

    2019. https://bigquery.cloud.google.com/dataset/fh-bigquery:redd it_comments. Accessed: 2019-04-19

  12. [12]

    Not Enough Sanders Spam

    2019. ANNOUNCEMENT: There is’t enough Sanders spam on Reddit, so this sub is now “Not Enough Sanders Spam”. Thank you for your co-operation. : enoughsandersspam. https://www.reddit.com/r/enoughsandersspam/com ments/asgmw9/announcement_there_isnt_enough_sanders_spam_on/

  13. [13]

    Are gore and death banned from being seen on reddit : ModSup- port

    2019. Are gore and death banned from being seen on reddit : ModSup- port. https://www.reddit.com/r/ModSupport/comments/b1hugd/are_go re_and_death_banned_from_being_seen_on/

  14. [14]

    A collection of the most illustrative moments of our horribly inferior clone community: enoughsandersspam

    2019. A collection of the most illustrative moments of our horribly inferior clone community: enoughsandersspam. https://www.reddit.com/r/enoug hsandersspam/comments/atsl4p/a_collection_of_the_most_illustrati ve_moments_of/

  15. [15]

    Content Policy - Reddit

    2019. Content Policy - Reddit. https://www.redditinc.com/policies/con tent-policy

  16. [16]

    Homepage - Reddit

    2019. Homepage - Reddit. https://www.redditinc.com/

  17. [17]

    A Mass Murder of, and for, the Internet - The New York Times

    2019. A Mass Murder of, and for, the Internet - The New York Times

  18. [18]

    Ajay Bhalla and Joseph Lampel. 2007. The Role of Status Seeking in Online Communities: Giving the Gift of Experience. Journal of Computer- Mediated Communication 12, 2 (01 2007), 434–455. https://doi.org/10. 1111/j.1083-6101.2007.00332.x arXiv:http://oup.prod.sis.lan/jcmc/article- pdf/12/2/434/22316595/jjcmcom0434.pdf

  19. [19]

    Iris Birman. 2018. Moderation in different communities on Reddit–A qualitative analysis study. Master’s thesis. Georgia Institute of Technology

  20. [20]

    Leo Breiman. 2017. Classification and regression trees. Routledge

  21. [21]

    Ali Breland. 2019. Anti-Muslim Hate Has Been Rampant on Reddit Since the New Zealand Shooting. Mother Joness. https://www.motherjones.com/po litics/2019/03/reddit-new-zealand-shooting-islamophobia/

  22. [22]

    John A Bullinaria and Joseph P Levy. 2007. Extracting semantic representations from word co-occurrence statistics: A computational study. Behavior research methods 39, 3 (2007), 510–526

  23. [23]

    Justin Caffier. 2017. Here Are RedditâĂŹs Whiniest, Most Low-Key Toxic Sub- reddits - VICE. https://www.vice.com/en_us/article/8xxymb/here-are -reddits-whiniest-most-low-key-toxic-subreddits

  24. [24]

    Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert. 2017. You can’t stay here: The efficacy of reddit’s 2015 ban examined through hate speech. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 31

  25. [25]

    Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert. 2018. The Internet’s Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 32

  26. [26]

    Samantha Cole. 2018. People Are Using AI to Create Fake Porn of Their Friends and Classmates - Motherboard. https://motherboard.vice.com/en_us/art icle/ev5eba/ai-fake-porn-of-friends-deepfakes

  27. [27]

    Ben Collins. 2017. Reddit Backs Its Neo-Nazis Four Months After Banning Alt- Right. https://www.thedailybeast.com/reddit-backs-its-neo-nazis -four-months-after-banning-alt-right

  28. [28]

    Ben Collins. 2017. Reddit Bans Forum Inciting ‘Physical Removal’ of Democrats From Society. The Daily Beast. https://www.thedailybeast.com/reddit-b ans-forum-inciting-physical-removal-of-democrats-from-society

  29. [29]

    Ben Collins. 2017. Reddit Bans Forum Inciting âĂŸPhysical RemovalâĂŸ of Democrats From Society. https://www.thedailybeast.com/reddit-bans-f orum-inciting-physical-removal-of-democrats-from-society

  30. [30]

    Ben Collins and Brandy Zadronzny. 2018. After Toronto attack, on- line misogynists praise suspect as ’new saint’. NBC News. https: //www.nbcnews.com/news/us-news/after-toronto-attack-online-m isogynists-praise-suspect-new-saint-n868821

  31. [31]

    David Crandall, Dan Cosley, Daniel Huttenlocher, Jon Kleinberg, and Siddharth Suri. 2008. Feedback Effects Between Similarity and Social Influence in Online Communities. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’08) . ACM, New York, NY, USA, 160–168. https://doi.org/10.1145/1401890.1401914

  32. [32]

    Cristian Danescu-Niculescu-Mizil, Robert West, Dan Jurafsky, Jure Leskovec, and Christopher Potts. 2013. No Country for Old Members: User Lifecycle and Linguistic Change in Online Communities. In Proceedings of the 22Nd Interna- tional Conference on World Wide Web (WWW ’13) . ACM, New York, NY, USA, 307–318. https://doi.org/10.1145/2488388.2488416

  33. [33]

    Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. Automated Hate Speech Detection and the Problem of Offensive Language. In Proceedings of the 11th International AAAI Conference on Web and Social Media (ICWSM ’17). 512–515

  34. [34]

    Melanie Ehrenkranz. 2018. It Was Only a Matter of Time Before Internet Trolls Made More Sophisticated Fake Porn Videos. https://gizmodo.com/it-was -only-a-matter-of-time-before-internet-trolls-mad-1822463473

  35. [35]

    R.M. Fano. 1963. Transmission of Information: A Statistical Theory of Communi- cations. M.I.T. Press. https://books.google.com/books?id=UymSnQEACAAJ

  36. [36]

    Casey Fiesler, Joshua McCann, Kyle Frye, Jed R Brubaker, et al. 2018. Reddit rules! characterizing an ecosystem of governance. InTwelfth International AAAI Conference on Web and Social Media

  37. [37]

    Mark Follman and Josh Harkinson. 2018. How Reddit Became a Gun MarketâĂŤand Authorized Its Logo on Assault Rifles âĂŞ Mother Jones. https://www.motherjones.com/politics/2014/01/reddit-guns-a ssault-rifle-ar15-logo-conde-nast/

  38. [38]

    David Garcia, Pavlin Mavrodiev, and Frank Schweitzer. 2013. Social Resilience in Online Communities: The Autopsy of Friendster. In Proceedings of the First ACM Conference on Online Social Networks (COSN ’13) . ACM, New York, NY, USA, 39–50. https://doi.org/10.1145/2512938.2512946

  39. [39]

    R. Gazan. 2009. When Online Communities Become Self-Aware. In 2009 42nd Hawaii International Conference on System Sciences . 1–10. https://doi.org/ 10.1109/HICSS.2009.509

  40. [40]

    Bryan T. Gervais. 2014. Following the News? Reception of Uncivil Partisan Me- dia and the Use of Incivility in Political Expression. Political Communication 31, 4 (2014), 564–583. https://doi.org/10.1080/10584609.2013.852640

  41. [41]

    Jay Hathaway. 2018. Deepfakes: How Redditors Are Using AI To Make Fake Celebrity Porn. https://www.dailydot.com/unclick/deepfakes-ai-cel 16 ebrity-porn/

  42. [42]

    I laugh at the death of normies

    Rachel Janik. 2018. “I laugh at the death of normies”: How incels are celebrating the Toronto mass killing | Southern Poverty Law Cen- ter. https://www.splcenter.org/hatewatch/2018/04/24/i-laugh-death -normies-how-incels-are-celebrating-toronto-mass-killing

  43. [43]

    Dan Jurafsky. 2000. Speech & language processing . Pearson Education India

  44. [44]

    Cecilia Kang. 2016. Fake News Onslaught Targets Pizzeria as Nest of Child- Trafficking - The New York Times. https://www.nytimes.com/2016/11/21/ technology/fact-check-this-pizzeria-is-not-a-child-trafficking -site.html

  45. [45]

    In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16)

    Charles Kiene, Andrés Monroy-Hernández, and Benjamin Mako Hill. 2016. Sur- viving an “Eternal September”: How an Online Community Managed a Surge of Newcomers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16) . ACM, New York, NY, USA, 1152–1156. https: //doi.org/10.1145/2858036.2858356

  46. [46]

    Aditi Natasha Kini. 2017. How Reddit Is Used to Indoctrinate Young Men Into Becoming Misogynists - VICE. https://www.vice.com/en_ca/article/g yj3yw/how-reddit-is-used-to-indoctrinate-young-men-into-becomin g-misogynists

  47. [47]

    James Kosur. 2015. The Fappening Is Being Broadcast Live On Reddit With 100,000+ Viewers. https://www.business2community.com/social-buzz/ fappening-broadcast-live-reddit-100000-viewers-0995207

  48. [48]

    Michal Kranz. 2017. Former Milo intern and murderer was active in alt-right circles - Business Insider. https://www.businessinsider.com/former-mil o-yiannopoulos-intern-killed-his-own-father-alt-right-circles-o nline-trump-2017-10

  49. [49]

    2010.Structure and Evolution of Online Social Networks

    Ravi Kumar, Jasmine Novak, and Andrew Tomkins. 2010.Structure and Evolution of Online Social Networks . Springer New York, New York, NY, 337–357. https: //doi.org/10.1007/978-1-4419-6515-8_13

  50. [50]

    K Hazel Kwon and Anatoliy Gruzd. 2017. Is offensive commenting contagious online? Examining public vs interpersonal swearing in response to Donald TrumpâĂŹs YouTube campaign videos. Internet Research 27, 4 (2017), 991–1010

  51. [51]

    Christine Lagorio. 2018. How Reddit CEO Steve Huffman handled The_Donald subreddit. Fast Company. https://www.fastcompany.com/90244757/the-i nside-story-of-reddits-struggle-to-deal-with-its-most-toxic-p ro-trump-users

  52. [52]

    Christine Lagorio-Chafkin. 2017. How Charlottesville forced Reddit to clean up its act | Technology | The Guardian. https://www.theguardian.com/techno logy/2018/sep/23/reddit-charlottesville-we-are-the-nerds-book-e xtract-christine-lagorio-chafkin

  53. [53]

    Thomas K Landauer, Peter W Foltz, and Darrell Laham. 1998. An introduction to latent semantic analysis. Discourse processes 25, 2-3 (1998), 259–284

  54. [54]

    Noam Lapidot-Lefler and Azy Barak. 2012. Effects of anonymity, invisibility, and lack of eye-contact on toxic online disinhibition. Computers in human behavior 28, 2 (2012), 434–443

  55. [55]

    Ryan Mac. 2019. After The Proliferation Of The New Zealand Shoot- ing Video, Reddit Has Banned Two Channels Showing Human Death. https://www.buzzfeednews.com/article/ryanmac/reddit-bans-group s-death-gore-new-zealand-massacre-video

  56. [56]

    Andrew Marantz. 2018. Reddit and the Struggle to Detoxify the Internet. The New Yorker (2018)

  57. [57]

    Trevor Martin. 2017. Dissecting Trump’s Most Rabid Online Following | FiveThir- tyEight. https://fivethirtyeight.com/features/dissecting-trumps-m ost-rabid-online-following/

  58. [58]

    Adrienne Massanari. 2017. # Gamergate and The Fappening: How RedditâĂŹs algorithm, governance, and culture support toxic technocultures. New Media & Society 19, 3 (2017), 329–346

  59. [59]

    J Nathan Matias. 2016. Going dark: Social factors in collective action against plat- form operators in the Reddit blackout. In Proceedings of the 2016 CHI conference on human factors in computing systems . ACM, 1138–1151

  60. [60]

    J Nathan Matias. 2016. Posting rules in online discussions prevents problems & increases participation

  61. [61]

    Kelsey McKinney. 2014. Reddit made over $100,000 off stolen celebrity nudes - Vox. https://www.vox.com/jennifer-lawrence-celebrities-nude-pho to-hack-crime/2014/9/11/6135345/reddit-money-celebrity-hacking

  62. [62]

    Richard Mills and Adam Fish. 2015. A computational study of how and why red- dit. com was an effective platform in the campaign against sopa. InInternational Conference on Social Computing and Social Media . Springer, 229–241

  63. [63]

    Richard A Mills. 2018. Pop-up political advocacy communities on Reddit. com: SandersForPresident and The Donald. AI & SOCIETY 33, 1 (2018), 39–54

  64. [64]

    Christoph Molnar. 2019. Interpretable Machine Learning: A Guide for Making Black Box Models Explainable . https://christophm.github.io/interpret able-ml-book/logistic.html

  65. [65]

    Ian Morris. 2018. Deepfake Porn Banned By Reddit And Porn- hub After Taylor Swift And Meghan Markle Clips Emerge Online. https://www.forbes.com/sites/ianmorris/2018/02/07/deepfake-p orn-banned-by-reddit-and-pornhub-after-taylor-swift-and-megha n-markle-clips-emerge-online/#5a03903148ea

  66. [66]

    Jack Morse. 2019. Reddit waits until it’s too late to ban violence-glorifying sub- reddits. Mashable. https://me.mashable.com/tech/3194/reddit-waits-u ntil-its-too-late-to-ban-violence-glorifying-s

  67. [67]

    Fionn Murtagh and Pierre Legendre. 2014. WardâĂŹs hierarchical agglomera- tive clustering method: which algorithms implement WardâĂŹs criterion? Jour- nal of classification 31, 3 (2014), 274–295

  68. [68]

    Diana C Mutz. 2015. In-your-face politics: The consequences of uncivil media . Princeton University Press

  69. [69]

    Ngamkajornwiwat, D

    K. Ngamkajornwiwat, D. Zhang, A. G. Koru, L. Zhou, and a. R. Nolker. 2008. An Exploratory Study on the Evolution of OSS Developer Communities. InProceed- ings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008). 305–305. https://doi.org/10.1109/HICSS.2008.58

  70. [70]

    Rishab Nithyanand, Brian Schaffner, and Phillipa Gill. 2017. Measuring offensive speech in online political discourse. In7th {USENIX} Workshop on Free and Open Communications on the Internet ( {FOCI} 17)

  71. [71]

    Rishab Nithyanand, Brian Schaffner, and Phillipa Gill. 2017. Online political discourse in the Trump era. arXiv preprint arXiv:1711.05303 (2017)

  72. [72]

    Abby Ohlheiser. 2016. Fearing yet another witch hunt, Reddit bans ‘Pizzagate’. The Washington Post. https://www.washingtonpost.com/news/the-inter sect/wp/2016/11/23/fearing-yet-another-witch-hunt-reddit-bans-p izzagate/?noredirect=on&utm_term=.f1ff2b114b20

  73. [73]

    Abby Ohlheiser. 2018. Inside the online world of ’incels, ’ | Lifestyles | napaval- leyregister.com. https://napavalleyregister.com/lifestyles/inside-t he-online-world-of-incels/article_8df4aef3-5784-501b-8cc3-bb40d bb36cc6.html

  74. [74]

    Alexandra Olteanu, Carlos Castillo, Jeremy Boy, and Kush R Varshney. 2018. The effect of extremist violence on hateful speech online. In Twelfth International AAAI Conference on Web and Social Media

  75. [75]

    Simon Parkin. 2014. Gamergate: A Scandal Erupts in the Video-Game Commu- nity | The New Yorker. https://www.newyorker.com/tech/annals-of-tec hnology/gamergate-scandal-erupts-video-game-community

  76. [76]

    Adi Robertson. 2017. Reddit bans Nazi boards in crackdown on âĂŸviolentâĂŹ content - The Verge. https://www.theverge.com/2017/10/25/16548958/re ddit-ban-nazi-subreddit-violence-policy-change

  77. [77]

    Kevin Rose. 2018. ‘False Flag’ Theory on Pipe Bombs Zooms From Right-Wing Fringe to Mainstream. The New York Times. https: //www.nytimes.com/2018/10/25/business/false-flag-theory-bombs -conservative-media.html

  78. [78]

    The Fappening

    Christopher Spata. 2014. “The Fappening” Made Reddit Lots of Money | Com- plex. https://www.complex.com/pop-culture/2014/09/reddit-made-mon ey-the-fappening-nude-leak

  79. [79]

    Bijan Stephen. 2019. Reddit bans r/watchpeopledie in the wake of the New Zealand mosque massacres. The Verge. https://www.theverge.com/2019/ 3/15/18267645/reddit-watchpeopledie-ban-new-zealand-mosque-mas sacre-christchurch

  80. [80]

    John Suler. 2004. The online disinhibition effect. Cyberpsychology & behavior 7, 3 (2004), 321–326

Showing first 80 references.