Pith. sign in

REVIEW 5 major objections 5 minor 90 references

Social Contagion in COVID-19 Discussions within the Belgian Reddit Community: A Statistical and Modeling Study

T0 review · 5 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read COVID-19 mitigation topics on r/belgium are seeded externally, not through within-Reddit contagion, while sentiment does track the parent post.

desk verdict Useful empirical study with a clever latent-state sentiment model, but the headline 'no topic contagion' claim outruns the test that produced it. read the letter →

arxiv 2505.20185 v2 pith:6FPUQLOP submitted 2025-05-26 cs.SI physics.soc-ph

classification cs.SIphysics.soc-ph MSC 91D3062P2568T50
keywords COVID-19mitigationRedditsentimentanalysistopicmodellingsocialcontagionhomophilyboundedconfidencemodelinfodemic
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper studies 655,642 posts by 28,559 users in r/belgium from January 2020 to June 2022 and asks whether discussions of lockdowns, masks, and vaccination spread inside the community or are driven from outside. It concludes that topic initiation shows no social contagion: having participated in a discussion on one of these mitigation measures does not make a user more likely to start a new one, and post volume aligns with external announcements rather than with hospital or vaccination data. Sentiment behaves differently. Comments tend to match the sentiment of their parent post, producing homophily for all three topics, with lockdown discussions the most polarised. To explain this, the authors fit the Smooth Internal Expressed Bounded Confidence (SIEBC) model, which separates a latent internal sentiment from the expressed sentiment in each comment; the fit suggests expressed sentiment adapts strongly to the immediate parent while the internal state changes only slowly. If these findings hold, coupled epidemic-social models should seed discussion topics from outside the platform and model sentiment spread through bounded-confidence adaptation rather than treating Reddit sentiment as a direct opinion poll.

What carries the argument

The load-bearing object is the Smooth Internal Expressed Bounded Confidence (SIEBC) model, built around the smooth bounded-confidence kernel $B_{\alpha,\epsilon}(s_1,s_2) = s_1 + \alpha(s_2-s_1)/(1+\exp(\gamma((s_2-s_1)^2-\epsilon^2)))$, where $\alpha$ is the update strength, $\epsilon$ the opinion-difference threshold, and $\gamma=50$ sets the sharpness of the threshold. Each user has a latent internal sentiment $u_i[t]$ and an observable expressed sentiment $e_i[t]$; the expressed state is drawn from a truncated normal around the kernel applied to the internal state and the parent comment's sentiment, while the internal state evolves under the same kernel applied to all interactions received since the previous comment. The topic-contagion test uses a combinatoric null model over each user's sequence of initiations and participations, and the sentiment tests use a null model that randomly reconnects comment-parent sentiment pairs, summarised by the homophily measure $h$. The model is fitted per topic by MCMC, and its predictions are compared with observations using the Wasserstein metric, with WAIC used to compare against alternative specifications.

What would settle it

Human-annotate a random sample of initiating and participating posts and re-run the null-model statistic with corrected topic labels; if the corrected initiations cluster after participations rather than before them, the claim that discussion topics are not contagious within r/belgium would be refuted.

Watch

Extended reading notes

Core claim

The central discovery is an asymmetry between what spreads and what does not. On r/belgium, the volume of posts about lockdowns, masks, and vaccination tracks external events such as policy announcements, and a user's history of participating in a topic does not predict initiation of a new discussion on that topic; by a combinatoric null model, initiations occur earlier in a user's sequence than expected, not later. Sentiment, however, is contagious in a local sense: comment sentiment correlates with parent sentiment, homophily measures reach 0.228 (lockdowns), 0.198 (masks), and 0.133 (vaccination), and the effect is stronger for the thread ancestors a user reads than for the comments the user has previously written. Fitting the two-state SIEBC model, the paper finds that for most users the expressed sentiment adapts more to the parent comment than the latent state adapts to interaction history, so expressed sentiment is a noisy proxy for underlying opinion. The paper therefore proposes that infodemic models separate external topic seeding from internal sentiment adaptation.

Load-bearing premise

All downstream conclusions inherit whatever errors the automated classifiers make: the topic model must correctly assign posts to lockdown, mask, or vaccination topics in four languages, the English-only RoBERTa sentiment model must measure sentiment on Reddit well, and the no-contagion test assumes the within-user ordering null model is a meaningful test even though it never tracks what a user actually saw.

Editorial extensions

If this is right

  • Coupled epidemic-social models should not let topics arise spontaneously inside the simulated platform; topic popularity should be seeded by external information such as government announcements and media coverage.
  • Sentiment should be modeled with a bounded-confidence mechanism rather than a linear update rule, because the bounded SIEBC kernel reproduces the observed homophily while the linear kernel does not.
  • Expressed sentiment on Reddit should not be treated as a direct measure of underlying user opinion, since the parent comment's sentiment is a major influence on the reply's expressed sentiment.
  • The three mitigation topics should be followed separately in epidemic-social models, because lockdowns show the most volume and polarisation while vaccination shows the least homophily.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the external-seeding result generalizes, then measuring an infodemic from social media alone conflates two distinct processes: news-driven topic attention and platform-internal sentiment adaptation; a testable consequence is that topic initiation rates should track news or policy event intensity in other subreddits and countries.
  • Because sentiment was computed only on English posts, about 75% of the data, the paper leaves open whether parent-comment adaptation is identical in Dutch, French, and German threads; a replication with per-language sentiment classifiers would test the symmetry of the mechanism.
  • Because the internal sentiment estimates have no ground truth, a natural next test is to compare SIEBC-reconstructed internal states with later observable behaviour, such as leaving the subreddit, switching topics, or survey-reported attitudes.
  • If expressed sentiment is a poor proxy for underlying opinion, public-health sentiment dashboards should be recalibrated or paired with latent-state models rather than read as opinion polls.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. This manuscript studies 655,642 posts from the Belgian r/belgium subreddit between January 2020 and June 2022. Posts are classified into three mitigation topics (lockdowns, masks, vaccination) using a multilingual BERT model, and English-language posts are scored with a RoBERTa sentiment classifier. The authors report that topic volume tracks external events and that, based on a within-user ordering null model, users are not more likely to initiate a topic after having participated in it, leading to the conclusion that there is no social contagion in topic initiation. They further find sentiment homophily between comments and their parents, and introduce a Smooth Internal/Latent Expressed Bounded Confidence (SIEBC/SLEBC) model that distinguishes a latent internal sentiment from expressed sentiment, fitting it with MCMC. The abstract claims the model was evaluated against two alternatives by WAIC, but the full text reports only Wasserstein metric comparisons with a single linear kernel.

Significance. If fully supported, the distinction between externally driven topic adoption and sentiment-driven homophily would be a useful empirical input for infodemic and coupled epidemic-social models, and the bounded-confidence latent-state model is a plausible mechanistic contribution. The paper benefits from a large curated dataset, reproducible code, and a clear research question. However, the central negative claim about topic contagion is not supported by the analysis actually performed, and the model evaluation is partly in-sample and overclaimed in the abstract. These issues substantially reduce the confidence in the stated conclusions, though the descriptive components and the model itself retain value if reframed with appropriately bounded claims.

major comments (5)
  1. [6.2] Section 6.2, Eqs. (3)-(5): The null model randomizes the order of each user's own initiations and participations, so it can only detect whether a user's earlier participations in the same topic make that user's later initiations more likely. It does not measure whether users are exposed to same-topic posts written by other users before initiating, which is the standard meaning of social contagion. In particular, a user may read threads without commenting or may be influenced by another user's same-topic submission or comment, and the null model is blind to both mechanisms. The observed result that initiations tend to occur early in a user's sequence is therefore not evidence against cross-user contagion; it is merely evidence against a particular form of self-priming. The conclusion in Section 6.2 that 'there is no social contagion of discussions on the three mitigation topics within Reddit's r/belgium community, neither simple, nor complex' is an overstatement of what the test can show.
  2. [Abstract / Section 6.4] The abstract states that the model was 'Evaluated against two alternatives by WAIC, SLEBC fit best across all three topics.' However, the full text does not mention WAIC or a second alternative; Section 6.4 reports only Wasserstein metrics W1 for SIEBC versus a single linear kernel (Eq. (10)). Either the abstract describes an evaluation that is not reported in the body, or the body is missing the WAIC analysis. This mismatch must be resolved, and the model name should be unified (SLEBC in the abstract, SIEBC elsewhere).
  3. [6.4, 7.3] The SIEBC model is fitted to the expressed sentiments of the same users on which the homophily statistic h is later computed, so the statement that the model 'predicts' the observed homophily (also in Section 7.3) is an in-sample comparison rather than a predictive test. The absolute fit is weak (W1 between 0.493 and 0.607), the predicted sentiment distributions do not reproduce the neutral peak (Figure 8A-C), and for vaccination the predicted homophily differs markedly from the observed value. The authors should either provide an out-of-sample or cross-validated evaluation or explicitly reframe the homophily agreement as a descriptive fit.
  4. [4, 6.3, 6.4] Sentiment scores are assigned only to English-language posts (about 75% of the data); the sentiment homophily analysis (Section 6.3) and the SIEBC fit (Section 6.4) are therefore restricted to that subset. The results and conclusions, however, are phrased as statements about 'the r/belgium community' without this caveat, and Section 7.6 does not list this restriction among the limitations. The paper should state this limitation explicitly and discuss potential language-related biases in homophily and model parameters.
  5. [7.3, 7.6] The conclusion that 'expressed sentiment is a poor proxy for underlying opinion' depends on the latent internal state u_i[t] being a valid construct, yet Section 7.6 acknowledges that 'the obtained values for the internal state are not compared to a ground truth.' Without external validation, the interpretation of the latent state as 'actual sentiment' is speculative. The authors should either temper the claim or provide some form of validation, such as testing against user-level outcomes or known temporal events.
minor comments (5)
  1. [5.1] The threshold for significantly negative days (0.275 quantile and at least 50 comments) is chosen 'such that one to five negative days can be identified for each topic'; this data-dependent selection should be disclosed as exploratory rather than confirmatory, and the phrase 'significantly negative' should be used with caution.
  2. [4] Comments labeled 'not applicable' or 'other' are forced to inherit the topic of their parent; this rule may introduce systematic topic-assignment bias and should be justified or validated, especially because the parent-child topic relationship is later used in the homophily analysis.
  3. [Figure 8] In panel (D), the label 'h(∆H s)' appears to be a typo; it should be 'h(∆H)'.
  4. [5.3] The notation in Equation (7) is ambiguous: i and j are used both as bin indices and as midpoints; please clarify the indexing explicitly.
  5. [6.4] The sentence about the linear kernel saying 'the observed values being above the 0.95 quantile of the samples generated by the SIEBC model' is ambiguous: the text is in the paragraph about the linear kernel, but it compares observed homophily to SIEBC samples; clarify which model's samples are used.

Circularity Check

1 steps flagged · score 4.0 of 10

SIEBC's 'predicted homophily' is an in-sample fit to the same expressed sentiments used to estimate its parameters; no other circular steps found.

  1. fitted input called prediction [Section 6.4 and Section 7.3; Equations (7), (8), (11)]
    "Subjecting the predicted sentiments to the analysis of Section 5.3, reveals homophily in Figure 8D, as calculated by Equation (7). ... Even though it is not explicitly fitted on it, the SIEBC model manages to predict the observed homophily between comments well and thus demonstrates its value as a tool for the study of Reddit interactions."

    The SIEBC posterior is sampled 'given the likelihood based on the observed expressed sentiments' (Section 5.4, Equation (8)). The homophily statistic h (Equation (7)) and the Wasserstein metric (Equation (11)) are computed on exactly those same observed expressed sentiment values and their parent-comment pairings. The model-generated sentiments are therefore an in-sample fit to the very data that define the 'predicted' target; the agreement between predicted and observed h is statistically forced by the fitting objective. The phrase 'not explicitly fitted on it' distinguishes only the loss function, not the data source, so the claim that the model 'predicts' the observed homophily is a fitted input presented as an independent prediction.

full rationale

Most of the paper's derivation chain is self-contained. The topic-volume analysis (Section 6.1) compares post counts to external event dates and hospital/dose series, and the 'no initiation contagion' test (Sections 5.2 and 6.2) is a within-user permutation test whose observed rho(i) is data rather than a fitted quantity. The sentiment homophily result (Section 6.3) uses a null model built by permuting observed sentiment pairs, with the statistic h computed from the data; this is also independent of any fitted model. The main circularity is confined to the model-validation language: SIEBC parameters are fitted to the observed expressed sentiment sequences, and the same expressed sentiments define the homophily h and the Wasserstein comparison, so calling the resulting agreement a 'prediction' of homophily is an in-sample fit renamed as prediction. Section 7.6 honestly notes that the latent internal state has no ground-truth comparison, which limits the 'expressed sentiment is a poor proxy' inference but is not itself circular. The broad conclusion 'no social contagion, neither simple, nor complex' overstates what the within-user ordering test can show, because the test never measures exposure to other users' posts; however, this is a construct-validity gap rather than a circular reduction, since the null result is not an input to the test.

Assumptions & free parameters 8 free parameters · 6 assumptions · 1 invented entities

The model and analysis depend on a large number of chosen and fitted quantities: eight explicit free parameters, plus per-user posteriors, plus six implicit modeling assumptions. The internal sentiment is an invented latent entity without external validation. The most consequential free parameters are the negative-day thresholds, which are set post hoc to produce a desired count.

free parameters (8)
  • significantly negative day threshold quantile = 0.275
    Section 5.1: threshold chosen so that one to five negative days can be identified per topic; post-hoc selection.
  • minimum daily comment count = 50
    Section 5.1: chosen to filter days; together with quantile yields desired number of negative days.
  • bounded confidence shape parameter gamma = 50
    Section 5.4: fixed to 50 following ref [67]; controls steepness of smooth kernel.
  • prior means for alpha and sigma = exponential mean 0.5
    Section 5.4: chosen priors for MCMC; affect posterior.
  • prior range for epsilon = Uniform[0,2]
    Section 5.4: chosen so each meaningful epsilon equally likely.
  • per-user model parameters alpha_e, alpha_u, epsilon, sigma_e, sigma_u = posterior samples per user
    Section 5.4: fit to users with at least 40 comments (209, 101, 98 users per topic).
  • minimum comments per user for model fitting = 40
    Section 5.4/Table 3: threshold to select users; changes sample size.
  • homophily bin width = 0.05
    Section 5.3: wH=0.05 used to build histograms and define the homophily measure.
assumptions (6)
  • domain assumption The mbert-ctbt topic model correctly classifies posts into mitigation topics in Dutch, French, English, and German.
    Section 4: topic labels are assigned by a previously trained model; errors propagate to all analyses.
  • domain assumption twitter-roberta-base-sentiment-latest sentiment scores on English posts are valid for Reddit text and English posts represent the community.
    Section 4: only English posts receive sentiment; Dutch and French posts (about 25%) are dropped from sentiment analysis.
  • ad hoc to paper Comments labeled 'not applicable' or 'other' inherit the topic of their parent.
    Section 4: this imputation rule is introduced here; can inflate thread-level topic coherence.
  • domain assumption The null model for initiating contagion (randomizing within-user order while preserving counts) is a valid baseline for social contagion.
    Section 5.2/6.2: the null model only permutes a user's own initiation/participation order; it does not model exposure to other users' posts.
  • ad hoc to paper The smooth bounded confidence kernel B_{alpha,epsilon} with fixed gamma=50 captures sentiment update dynamics.
    Section 5.4: kernel is a modeling choice; linear kernel is formed as a limit.
  • ad hoc to paper The latent internal sentiment u_i is identifiable from expressed sentiment alone under the SIEBC model.
    Section 5.4/7.6: no ground truth for internal state; identifiability is assumed.
invented entities (1)
  • Internal sentiment state u_i[t]
    purpose: Latent variable representing a user's true sentiment, separate from expressed comment sentiment; used to reconstruct internal opinion trajectories.
    Section 5.4: u_i is not directly measurable; the paper acknowledges no ground truth (Section 7.6). It is identified only through the model's assumptions.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Social Contagion in COVID-19 Discussions within the Belgian Reddit Community: A Statistical and Modeling Study." pith.science (2026). https://pith.science/paper/6FPUQLOP

@misc{pith2026250520185,
  author       = {Pith},
  title        = {Pith review of: Social Contagion in COVID-19 Discussions within the Belgian Reddit Community: A Statistical and Modeling Study},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/6FPUQLOP}},
  note         = {Machine review of arXiv:2505.20185}
}
read the original abstract

Understanding how sentiment toward COVID-19 mitigation measures evolves on social media can inform both epidemiological models and public health policy. We analyzed 655,642 posts by 28,559 users on r/Belgium from January 2020 to June 2022, classifying posts into three mitigation topics (lockdowns, masks, vaccinations) using a BERT-based topic model and scoring sentiment with a RoBERTa-based classifier. Post volume tracked external events such as policy announcements, but we found no evidence of within-Reddit social contagion in topic initiation, suggesting topics are seeded by external information rather than platform-internal spread. Sentiment, however, exhibited significant homophily: comment sentiment correlated with that of the parent post. To capture the underlying dynamics, we developed the Smooth Latent-Expressed Bounded Confidence (SLEBC) model, which distinguishes a latent sentiment trajectory from noisy expressed sentiment and uses bounded confidence rather than linear update rules. Evaluated against two alternatives by WAIC, SLEBC fit best across all three topics. The model indicates that expressed sentiment adapts more strongly to the immediate parent comment than the user's latent state updates from interaction history, suggesting that expressed sentiment is a poor proxy for underlying opinion. These findings imply that infodemic models for Reddit-like platforms should seed topics from external sources and model sentiment spread via bounded confidence mechanisms.

Figures

Figures reproduced from arXiv: 2505.20185 by the authors.

Figure 1
Figure 1. Structure of a Reddit thread. The parent and ancestors of the focal comment are shown. The initiating posts for the [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. The distribution of posts made per user on a double logarithmic scale for the topic ( [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. (A) Schematic representation of the Smooth Internal Expressed Bounded Confidence (SIEBC, Equation (8)). (B) The change in sentiment after applying Bα,ϵ (Equation (9)) as a function of the sentiment difference s2 − s1. mass. A higher value of h thus implies a higher level of homophily. A negative value indicates the opposite, heterophily, where interactions between opposing sentiments are more common than expected. W… view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: The number of posts per day on (A) lockdowns, (C) masks, (D) vaccination, (B) the number of hospitalisations, and (E) the number vaccination doses in Belgium. All quantities are shown as their two-week rolling mean. Piecewise linear trends are given by dashed lines. Re…
Figure 5
Figure 5. Figure 5: Proportion of users ρ(i) that has at least one initiated post in the first i discussions for the three topics, (A) lockdowns, (B) masks, and (C) vaccination. The full line represents the observed proportion, the dashed line the expected proportion under the null model.…
Figure 6
Figure 6. Figure 6: Normalised histograms of (A,B,C) observed sentiment interactions, and (D,E,F) the difference with the null model for the topics (A,D) lockdowns, (B,E) masks, and (C,F) vaccination. 15 [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]
Figure 7
Figure 7. Figure 7: Measure of homophily h between the sentiment of a comment and its size n ancestral (black) or user (gray) context for the topics (A) lockdowns, (B) masks, and (C) vaccination. findings in Section 6.3. Compared to αe, the values of the internal update strength αu are mo…
Figure 8
Figure 8. Figure 8: Outcomes of the fitted posterior of the SIEBC model. Normalised distributions [PITH_FULL_IMAGE:figures/full_fig_p017_8.png]
Figure 9
Figure 9. Figure 9: Median internal sentiment ˜u of users over time (full black curve) for the topics (A) lockdowns, (B) masks, and (C) vaccination. The area between the first and third quartile is shaded. 18 [PITH_FULL_IMAGE:figures/full_fig_p018_9.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

90 extracted references · 52 canonical work pages

  1. [1]

    Baumgartner, S

    J. Baumgartner, S. Zannettou, B. Keegan, M. Squire, J. Blackburn, The Pushshift Reddit dataset, Proceedings of the International Aaai Conference on Web and Social Media 14 (2020) 830–839. doi:10.1609/icwsm.v14i1.7347

  2. [2]

    van den Broek-Altenburg, A

    E. van den Broek-Altenburg, A. Atherly, Adherence to COVID-19 policy measures: Behavioral insights from The Nether- lands and Belgium, PLOS ONE 16 (5) (2021) e0250302. doi:10.1371/journal.pone.0250302

  3. [3]

    Luyten, E

    J. Luyten, E. Schokkaert, Belgium’s response to the COVID-19 pandemic, Health Economics, Policy and Law 17 (1) (2022) 37–47. doi:10.1017/S1744133121000232

  4. [4]

    Cinelli, W

    M. Cinelli, W. Quattrociocchi, A. Galeazzi, C. M. Valensise, E. Brugnoli, A. L. Schmidt, P. Zola, F. Zollo, A. Scala, The COVID-19 social media infodemic, Scientific Reports 10 (1) (2020) 16598. doi:10.1038/s41598-020-73510-5

  5. [5]

    Bedson, L

    J. Bedson, L. A. Skrip, D. Pedi, S. Abramowitz, S. Carter, M. F. Jalloh, S. Funk, N. Gobat, T. Giles-Vernick, G. Chowell, J. R. de Almeida, R. Elessawi, S. V. Scarpino, R. A. Hammond, S. Briand, J. M. Epstein, L. H´ ebert-Dufresne, B. M. Althouse, A review and agenda for integrated disease models including social and behavioural factors, Nature Human Beha...

  6. [6]

    T. W. Alleman, J. Vergeynst, L. De Visscher, M. Rollier, E. Torfs, I. Nopens, J. M. Baetens, Assessing the effects of non-pharmaceutical interventions on sars-cov-2 transmission in belgium by means of an extended seiqrd model and public mobility data, Epidemics 37 (2021) 100505. doi:10.1016/j.epidem.2021.100505

  7. [7]

    H. Du, M. Zahn, S. Loo, T. Alleman, S. Truelove, B. Patenaude, L. Gardner, N. Papageorge, A. Hill, Modeling dynamic disease-behavior feedbacks for improved epidemic prediction and response, medRxiv [preprint] (2024). doi:10.1101/2024. 11.16.24317352

  8. [8]

    A. H. Alamoodi, B. B. Zaidan, A. A. Zaidan, O. S. Albahri, K. I. Mohammed, R. Q. Malik, E. M. Almahdi, M. A. Chyad, Z. Tareq, A. S. Albahri, H. Hameed, M. Alaa, Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: A systematic review, Expert Systems with Applications 167 (114155) (2021). doi:10.1016/j.eswa.2020.114155

Show all 90 references
  1. [9]

    Kurten, K

    S. Kurten, K. Beullens, #Coronavirus: Monitoring the Belgian Twitter discourse on the severe acute respiratory syndrome coronavirus 2 pandemic, Cyberpsychology, Behavior, and Social Networking 24 (2) (2021) 117–122. doi:10.1089/cyber. 2020.0341. 21

  2. [10]

    C. A. Melton, O. A. Olusanya, N. Ammar, A. Shaban-Nejad, Public sentiment analysis and topic modeling regarding COVID-19 vaccines on the Reddit social media platform: A call to action for strengthening vaccine confidence, Journal Of Infection And Public Health 14 (10) (2021) 1...

  3. [11]

    W. Chipidza, The effect of toxicity on COVID-19 news network formation in political subcommunities on Reddit: An affili- ation network approach, International Journal Of Information Management 61 (2021) 102397. doi:10.1016/j.ijinfomgt. 2021.102397

  4. [12]

    Cheng, B

    T. Cheng, B. Han, Y. Liu, Exploring public sentiment and vaccination uptake of COVID-19 vaccines in England: a spatiotemporal and sociodemographic analysis of Twitter data, Frontiers In Public Health 11 (2023) 1193750. doi: 10.3389/fpubh.2023.1193750

  5. [13]

    Scott, P

    K. Scott, P. Delobelle, B. Berendt, Measuring shifts in attitudes towards COVID-19 measures in Belgium, Computational Linguistics in the Netherlands Journal 11 (2021) 161–171. URL https://clinjournal.org/clinj/article/view/133

  6. [14]

    W. Yin, J. Hay, D. Roth, Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach, arXiv [preprint] (2019). doi:10.48550/arXiv.1909.00161

  7. [15]

    D. M. Blei, A. Y. Ng, M. I. Jordan, Latent Dirichlet allocation, Journal of Machine Learning Research 3 (Jan) (2003) 993–1022. URL https://www.jmlr.org/papers/v3/blei03a.html

  8. [16]

    Grootendorst, BERTopic: Neural topic modeling with a class-based TF-IDF procedure, arXiv [preprint] (2022)

    M. Grootendorst, BERTopic: Neural topic modeling with a class-based TF-IDF procedure, arXiv [preprint] (2022). doi: 10.48550/arXiv.2203.05794

  9. [17]

    Hutto, E

    C. Hutto, E. Gilbert, Vader: A parsimonious rule-based model for sentiment analysis of social media text, Proceedings of the International AAAI Conference on Web and Social Media 8 (1) (2014) 216–225. doi:10.1609/icwsm.v8i1.14550

  10. [18]

    doi:10.57967/ hf/1515

    NLP Town, Bert-base-multilingual-uncased-sentiment (revision edd66ab), Hugging Face [software] (2023). doi:10.57967/ hf/1515

  11. [19]

    Barbieri, J

    F. Barbieri, J. Camacho-Collados, L. Neves, L. Espinosa-Anke, TweetEval: Unified benchmark and comparative evaluation for tweet classification, arXiv [preprint] (2020). doi:10.48550/arXiv.2010.12421

  12. [20]

    Brambilla, A

    M. Brambilla, A. Javadian Sabet, K. Kharmale, A. E. Sulistiawati, Graph-based conversation analysis in social media, Big Data and Cognitive Computing 6 (4) (2022) 113. doi:10.3390/bdcc6040113

  13. [21]

    Gatto, M

    J. Gatto, M. Basak, Y. Srivastava, P. Bohlman, S. M. Preum, Scope of large language models for mining emerging opinions in online health discourse, arXiv [preprint] (2024). doi:10.48550/arXiv.2403.03336

  14. [22]

    Cinelli, G

    M. Cinelli, G. De Francisci Morales, A. Galeazzi, W. Quattrociocchi, M. Starnini, The echo chamber effect on social media, Proceedings of the National Academy of Sciences 118 (9) (2021) e2023301118. doi:10.1073/pnas.2023301118

  15. [23]

    Falkenberg, A

    M. Falkenberg, A. Galeazzi, M. Torricelli, N. Di Marco, F. Larosa, M. Sas, A. Mekacher, W. Pearce, F. Zollo, W. Quat- trociocchi, A. Baronchelli, Growing polarization around climate change on social media, Nature Climate Change 12 (12) (2022) 1114–1121. doi:10.1038/s41558-022-01527-x

  16. [24]

    Rodriguez-Ib´ anez, A

    M. Rodriguez-Ib´ anez, A. Cas´ anez-Ventura, F. Castej´ on-Mateos, P.-M. Cuenca-Jim´ enez, A review on sentiment analysis from social media platforms, Expert Systems with Applications 223 (2023) 119862. doi:10.1016/j.eswa.2023.119862

  17. [25]

    Infodemic

    R. J. Medford, S. N. Saleh, A. Sumarsono, T. M. Perl, C. U. Lehmann, An “Infodemic”: Leveraging high-volume Twitter data to understand early public sentiment for the coronavirus disease 2019 outbreak, Open Forum Infectious Diseases 7 (7) (2020) ofaa258. doi:10.1093/ofid/ofaa258

  18. [26]

    H. D. Lanier, M. I. Diaz, S. N. Saleh, C. U. Lehmann, R. J. Medford, Analyzing COVID-19 disinformation on Twitter using the hashtags #scamdemic and #plandemic: Retrospective study, PLOS ONE 17 (6) (2022) e0268409. doi:10.1371/ journal.pone.0268409

  19. [27]

    T. Y. Xie, Y. R. Ge, Q. Xu, S. Chen, Public awareness and sentiment analysis of COVID-related discussions using BERT-based infoveillance, AI 4 (1) (2023) 333–347. doi:10.3390/ai4010016

  20. [28]

    Kobayashi, Y

    R. Kobayashi, Y. Takedomi, Y. Nakayama, T. Suda, T. Uno, T. Hashimoto, M. Toyoda, N. Yoshinaga, M. Kitsuregawa, L. E. C. Rocha, Evolution of public opinion on COVID-19 vaccination in Japan: Large-scale Twitter data analysis, Journal of Medical Internet Research 24 (12) (2022) ...

  21. [29]

    Pierri, M

    F. Pierri, M. R. DeVerna, K.-C. Yang, D. Axelrod, J. Bryden, F. Menczer, One year of COVID-19 vaccine misinformation on Twitter: Longitudinal study, Journal of Medical Internet Research 25 (2023) e42227. doi:10.2196/42227

  22. [30]

    Bonifazi, B

    G. Bonifazi, B. Breve, S. Cirillo, E. Corradini, L. Virgili, Investigating the COVID-19 vaccine discussions on Twitter through a multilayer network-based approach, Information Processing & Management 59 (6) (2022) 103095. doi:10. 1016/j.ipm.2022.103095

  23. [31]

    A. N. Medvedev, R. Lambiotte, J.-C. Delvenne, The anatomy of Reddit: An overview of academic research, in: F. Ghan- barnejad, R. Saha Roy, F. Karimi, J.-C. Delvenne, B. Mitra (Eds.), Dynamics On and Of Complex Networks III, Springer International Publishing, Cham, 2019, pp. 18...

  24. [32]

    Z. Tan, A. Datta, The first year of the Covid-19 pandemic through the lens of r/Coronavirus subreddit: An exploratory study, Health and Technology 13 (2) (2023) 301–326. doi:10.1007/s12553-023-00734-6

  25. [33]

    W. Wu, H. Lyu, J. Luo, Characterizing discourse about COVID-19 vaccines: A Reddit version of the pandemic story, Health Data Science 2021 (2021) 9837856. doi:10.34133/2021/9837856

  26. [34]

    Basile, F

    V. Basile, F. Cauteruccio, G. Terracina, How dramatic events can affect emotionality in social posting: The impact of COVID-19 on Reddit, Future Internet 13 (2) (2021) 29. doi:10.3390/fi13020029

  27. [35]

    M. M. E. Yurtsever, M. Shiraz, E. Ekinci, S. Eken, Comparing COVID-19 vaccine passports attitudes across countries by analysing Reddit comments, Journal of Information Science (2023) 01655515221148356 doi:10.1177/01655515221148356

  28. [36]

    Y. Liu, C. Whitfield, T. Zhang, A. Hauser, T. Reynolds, M. Anwar, Monitoring COVID-19 pandemic through the lens of social media using natural language processing and machine learning, Health Information Science And Systems 9 (1) 22 (2021) 25. doi:10.1007/s13755-021-00158-4

  29. [37]

    C. Yan, M. Law, S. Nguyen, J. Cheung, J. Kong, Comparing public sentiment toward COVID-19 vaccines across Canadian cities: Analysis of comments on Reddit, Journal of Medical Internet Research 23 (9) (2021) e32685. doi:10.2196/32685

  30. [38]

    B. Park, I. S. Jang, D. Kwak, Sentiment analysis of the COVID-19 vaccine perception, Health Informatics Journal 30 (1) (2024) 14604582241236131. doi:10.1177/14604582241236131

  31. [39]

    Gozzi, M

    N. Gozzi, M. Tizzani, M. Starnini, F. Ciulla, D. Paolotti, A. Panisson, N. Perra, Collective response to media coverage of the COVID-19 pandemic on Reddit and Wikipedia: Mixed-methods analysis, Journal of Medical Internet Research 22 (10) (2020) e21597. doi:10.2196/21597

  32. [40]

    M. Hu, M. Conway, Perspectives of the COVID-19 pandemic on Reddit: Comparative natural language processing study of the United States, the United Kingdom, Canada, and Australia, JMIR Infodemiology 2 (2) (2022) e36941. doi: 10.2196/36941

  33. [41]

    Kumar, I

    N. Kumar, I. Corpus, M. Hans, N. Harle, N. Yang, C. McDonald, S. N. Sakai, K. Janmohamed, K. Chen, F. L. Altice, W. Tang, J. L. Schwartz, S. M. Jones-Jang, K. Saha, S. A. Memon, C. T. Bauch, M. D. Choudhury, O. Papakyriakopoulos, J. D. Tucker, A. Goyal, A. Tyagi, K. Khoshnood,...

  34. [42]

    L. D. Ngueleo, J. P. Disso, A. A. Tekemetieu, J. M. Ngossaha, M. N. Kameni, Analysis of public sentiment regarding COVID-19 vaccines on the social media platform Reddit, Journal of Computer and Communications 12 (2) (2024) 80–108. doi:10.4236/jcc.2024.122006

  35. [43]

    Duraivel, Lavanya, A

    S. Duraivel, Lavanya, A. Augustine, Understanding vaccine hesitancy with application of latent Dirichlet allocation to Reddit corpora, Indian Journal of Science and Technology 15 (37) (2022) 1868–1875. doi:10.17485/IJST/v15i37.687

  36. [44]

    Alipour, A

    S. Alipour, A. Galeazzi, E. Sangiorgio, M. Avalle, L. Bojic, M. Cinelli, W. Quattrociocchi, Cross-platform social dynamics: An analysis of ChatGPT and COVID-19 vaccine conversations, Scientific Reports 14 (1) (2024) 2789. doi:10.1038/ s41598-024-53124-x

  37. [45]

    Corradini, Deconstructing cultural appropriation in online communities: A multilayer network analysis approach, Information Processing & Management 61 (3) (2024) 103662

    E. Corradini, Deconstructing cultural appropriation in online communities: A multilayer network analysis approach, Information Processing & Management 61 (3) (2024) 103662. doi:10.1016/j.ipm.2024.103662

  38. [46]

    De Francisci Morales, C

    G. De Francisci Morales, C. Monti, M. Starnini, No echo in the chambers of political interactions on Reddit, Scientific Reports 11 (1) (2021) 2818. doi:10.1038/s41598-021-81531-x

  39. [47]

    Jasser, I

    J. Jasser, I. Garibay, S. Scheinert, A. V. Mantzaris, Controversial information spreads faster and further than non- controversial information in Reddit, Journal of Computational Social Science 5 (1) (2022) 111–122. doi:10.1007/ s42001-021-00121-z

  40. [48]

    Bonifazi, F

    G. Bonifazi, F. Cauteruccio, E. Corradini, M. Marchetti, L. Sciarretta, D. Ursino, L. Virgili, A space-time framework for sentiment scope analysis in social media, Big Data And Cognitive Computing 6 (4) (2022) 130. doi:10.3390/bdcc6040130

  41. [49]

    Bonifazi, F

    G. Bonifazi, F. Cauteruccio, E. Corradini, M. Marchetti, G. Terracina, D. Ursino, L. Virgili, A framework for investigating the dynamics of user and community sentiments in a social platform, Data & Knowledge Engineering 146 (2023) 102183. doi:10.1016/j.datak.2023.102183

  42. [50]

    Goglia, D

    D. Goglia, D. Vega, Structure and dynamics of growing networks of Reddit threads, Applied Network Science 9 (1) (2024) 1–23. doi:10.1007/s41109-024-00654-y

  43. [51]

    Guilbeault, J

    D. Guilbeault, J. Becker, D. Centola, Complex contagions: A decade in review, in: S. Lehmann, Y.-Y. Ahn (Eds.), Complex Spreading Phenomena in Social Systems: Influence and Contagion in Real-World Social Networks, Springer International Publishing, Cham, 2018, pp. 3–25. doi:10...

  44. [52]

    A. F. Peralta, J. Kert´ esz, G. I˜ niguez, Opinion dynamics in social networks: From models to data, arXiv [preprint] (2022). doi:10.48550/ARXIV.2201.01322

  45. [53]

    I. V. Kozitsin, A general framework to link theory and empirics in opinion formation models, Scientific Reports 12 (1) (2022) 5543. doi:10.1038/s41598-022-09468-3

  46. [54]

    State, L

    B. State, L. Adamic, The diffusion of support in an online social movement: Evidence from the adoption of equal- sign profile pictures, in: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW ’15, Association for Computing Mac...

  47. [55]

    Centola, The spread of behavior in an online social network experiment, Science 329 (5996) (2010) 1194–1197

    D. Centola, The spread of behavior in an online social network experiment, Science 329 (5996) (2010) 1194–1197. doi: 10.1126/science.1185231

  48. [56]

    W. Cota, S. C. Ferreira, R. Pastor-Satorras, M. Starnini, Quantifying echo chamber effects in information spreading over political communication networks, EPJ Data Science 8 (1) (2019) 1–13. doi:10.1140/epjds/s13688-019-0213-9

  49. [57]

    Baumann, P

    F. Baumann, P. Lorenz-Spreen, I. M. Sokolov, M. Starnini, Modeling echo chambers and polarization dynamics in social networks, Physical Review Letters 124 (4) (2020) 048301. doi:10.1103/PhysRevLett.124.048301

  50. [58]

    Ferraz de Arruda, F

    H. Ferraz de Arruda, F. Maciel Cardoso, G. Ferraz de Arruda, A. R. Hern´ andez, L. da Fontoura Costa, Y. Moreno, Modelling how social network algorithms can influence opinion polarization, Information Sciences 588 (2022) 265–278. doi:10.1016/j.ins.2021.12.069

  51. [59]

    C. M. Valensise, M. Cinelli, W. Quattrociocchi, The drivers of online polarization: Fitting models to data, Information Sciences 642 (2023) 119152. doi:10.1016/j.ins.2023.119152

  52. [60]

    Papariello, xlm-roberta-base-language-detection, Hugging Face [software] (2024)

    L. Papariello, xlm-roberta-base-language-detection, Hugging Face [software] (2024). doi:10.57967/hf/2064

  53. [61]

    Loureiro, F

    D. Loureiro, F. Barbieri, L. Neves, L. Espinosa Anke, J. Camacho-collados, TimeLMs: Diachronic language models from Twitter, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Association for Computational Lingui...

  54. [62]

    Huang, X

    X. Huang, X. Tang, Analyzing replies and interactions among users with different stances: A case study of the Russia- 23 Ukraine conflict, in: X. Tang, V. N. Huynh, H. Xia, Q. Bai (Eds.), Knowledge and Systems Sciences, Springer Nature, Singapore, 2025, pp. 109–123. doi:10.100...

  55. [63]

    Koco´ n, I

    J. Koco´ n, I. Cichecki, O. Kaszyca, M. Kochanek, D. Szyd lo, J. Baran, J. Bielaniewicz, M. Gruza, A. Janz, K. Kanclerz, A. Koco´ n, B. Koptyra, W. Mieleszczenko-Kowszewicz, P. Mi lkowski, M. Oleksy, M. Piasecki, L. Radli´ nski, K. Wojtasik, S. Wo´ zniak, P. Kazienko, ChatGPT:...

  56. [64]

    Mancini, A

    A. Mancini, A. Desiderio, R. Di Clemente, G. Cimini, Self-induced consensus of Reddit users to characterise the GameStop short squeeze, Scientific Reports 12 (1) (2022) 13780. doi:10.1038/s41598-022-17925-2

  57. [65]

    Sciensano, COVID-19, Sciensano [dataset], https://epistat.sciensano.be/covid/ (accessed on 2024-09-14)

  58. [66]

    Hegselmann, U

    R. Hegselmann, U. Krause, et al., Opinion dynamics and bounded confidence models, analysis, and simulation, Journal of artificial societies and social simulation 5 (3) (2002). URL https://jasss.soc.surrey.ac.uk/5/3/2.html

  59. [67]

    H. Z. Brooks, P. S. Chodrow, M. A. Porter, Emergence of polarization in a sigmoidal bounded-confidence model of opinion dynamics, Siam Journal on Applied Dynamical Systems 23 (2) (2024) 1442–1470. doi:10.1137/22M1527258

  60. [68]

    M. H. DeGroot, Reaching a consensus, Journal of the American Statistical Association 69 (345) (1974) 118–121. doi: 10.2307/2285509

  61. [69]

    H. Ge, K. Xu, Z. Ghahramani, Turing: A language for flexible probabilistic inference, in: International Conference on Artificial Intelligence and Statistics, AISTATS 2018, 9-11 April 2018, Playa Blanca, Lanzarote, Canary Islands, Spain, 2018, pp. 1682–1690. URL https://proceed...

  62. [70]

    M. D. Hoffman, A. Gelman, The No-U-Turn Sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo, Journal of Machine Learning Research 15 (47) (2014) 1593–1623. URL https://www.jmlr.org/papers/v15/hoffman14a.html

  63. [71]

    Ramdas, N

    A. Ramdas, N. G. Trillos, M. Cuturi, On Wasserstein two-sample testing and related families of nonparametric tests, Entropy 19 (2) (2017) 47. doi:10.3390/e19020047

  64. [72]

    H. B. Mann, D. R. Whitney, On a test of whether one of two random variables is stochastically larger than the other, The Annals of Mathematical Statistics 18 (1) (1947) 50–60. doi:10.1214/aoms/1177730491

  65. [73]

    Binnenlandse Zaken, Ministerieel besluit houdende dringende maatregelen om de verspreiding van het coronavirus COVID- 19 te beperken, Federale Overheidsdient Justitie, eJustice, https://www.ejustice.just.fgov.be/eli/besluit/2020/03/ 13/2020030303/justel (accessed on 2024-11-15...

  66. [74]

    S. Wilm` es, Start van fase 3 van het afbouwplan vanaf 8 juni, Federale Overheidsdienst Volksgezondheid, https://www.info- coronavirus.be/nl/news/nvr-0306/ (accessed on 2024-11-15) (Jun. 2020)

  67. [75]

    T. Santens, Boete tot 1.600 euro voor wie avondklok schendt, sporten mag zonder masker: dit is nu vastgelegd in Antwerpen, VRT Nieuws, https://www.vrt.be/vrtnws/nl/2020/07/29/antwerpse-maatregelen/ (accessed on 2024-11-

  68. [76]

    R. Arnoudt, Antwerpse maatregelen bijgestuurd: Horeca langer open, avondklok wordt nachtk- lok, evenementen weer mogelijk, VRT Nieuws, https://www.vrt.be/vrtnws/nl/2020/08/12/ antwerpse-gouverneur-maakt-een-nachtklok-van-de-avondklok/ (accessed on 2024-11-15) (Aug. 2020)

  69. [77]

    De Croo, COVID-19 alarmniveau gaat in: strengere regels vanaf maandag 19 oktober, Premier.be, https://www

    A. De Croo, COVID-19 alarmniveau gaat in: strengere regels vanaf maandag 19 oktober, Premier.be, https://www. premier.be/nl/covid-19-alarmniveau-gaat-strengere-regels-vanaf-maandag-19-oktober (accessed on 2024-11-15) (Oct. 2020)

  70. [78]

    Overlegcomit´ e, Zomerplan: in vier stappen naar normaler levens, Belgium.be,https://www.belgium.be/nl/nieuws/2021/ zomerplan_vier_stappen_naar_normaler_levens (accessed on 2024-11-15) (May 2021)

  71. [79]

    Binnenlandse Zaken, Koninklijk besluit houdende wijziging van het koninklijk besluit van 28 oktober 2021 houdende de nodige maatregelen van bestuurlijke politie teneinde de gevolgen voor de volksgezondheid van de afgekondigde epidemische noodsituatie betreffende de coronavirus...

  72. [80]

    Overlegcomit´ e, Code oranje vanaf 18 februari 2022: geen sluitingsuur horeca meer, nachtleven open, Belgium.be, https://www.belgium.be/nl/nieuws/2022/code_oranje_vanaf_18_februari_2022_geen_sluitingsuur_horeca_meer_ nachtleven_open (accessed on 2024-11-15) (Feb. 2022)

  73. [81]

    TT, Mondmaskers vanaf zaterdag verplicht in alle winkels, bioscopen, gebed- shuizen, bibliotheken en musea, Het Laatste Nieuws, https://www.hln.be/binnenland/ mondmaskers-vanaf-zaterdag-verplicht-in-alle-winkels-bioscopen-gebedshuizen-bibliotheken-en-musea ~a8e6f1e8/ (accessed...

  74. [82]

    Overlegcomit´ e, Overlegcomit´ e bepaalt federale sokkel mondmaskerplicht, Belgium.be, https://www.belgium.be/nl/ nieuws/2021/overlegcomite_bepaalt_federale_sokkel_mondmaskerplicht (accessed on 2024-11-16) (Sep. 2021)

  75. [83]

    belgium.be/nl/nieuws/2021/overlegcomite_voortaan_brede_mondmaskerplicht_en_verplicht_telewerk (accessed on 2024-11-16) (Nov

    Overlegcomit´ e, Overlegcomit´ e: voortaan brede mondmaskerplicht en verplicht telewerk, Belgium.be, https://www. belgium.be/nl/nieuws/2021/overlegcomite_voortaan_brede_mondmaskerplicht_en_verplicht_telewerk (accessed on 2024-11-16) (Nov. 2021)

  76. [84]

    Binnenlandse Zaken, Koninklijk besluit houdende wijziging van het koninklijk besluit van 28 oktober 2021 houdende de nodige maatregelen van bestuurlijke politie teneinde de gevolgen voor de volksgezondheid van de afgekondigde epi- demische noodsituatie betreffende de coronavir...

  77. [85]

    Thanh Le, Z

    T. Thanh Le, Z. Andreadakis, A. Kumar, R. G´ omez Rom´ an, S. Tollefsen, M. Saville, S. Mayhew, The COVID-19 vaccine development landscape, Nature Reviews Drug Discovery 19 (5) (2020) 305–306. doi:10.1038/d41573-020-00073-5

  78. [86]

    E. Maerevoet, Jos Hermans (96) krijgt als eerste Vlaming vaccin: ”Blij dat ik spuit krijg, ik wil 100 worden”, VRT Nieuws, https://www.vrt.be/vrtnws/nl/2020/08/12/antwerpse-gouverneur-maakt-een-nachtklok-van-de-avondklok/ (ac- cessed on 2024-11-16) (Dec. 2020)

  79. [87]

    R. Arnoudt, Derde prik voor bewoners woonzorgcentra, nog geen beslissing over thuiswonende 85-plussers, VRT Nieuws, https://www.vrt.be/vrtnws/nl/2021/09/22/bewoners-van-woonzorgcentra-krijgen-derde-prik-coronavaccin/ (ac- cessed on 2024-11-16) (Sep. 2021)

  80. [88]

    Paelinck, Federale regering bereikt compromis over verplichte vaccinatie in de zorg, VRT Nieuws, https://www.vrt

    G. Paelinck, Federale regering bereikt compromis over verplichte vaccinatie in de zorg, VRT Nieuws, https://www.vrt. be/vrtnws/nl/2021/11/19/akkoord-vaccin/ (accessed on 2024-11-16) (Nov. 2021)

  81. [89]

    G. Galindo, 30% of Belgians not in favour of getting coronavirus vaccine, The Brussels Times, https:// www.brusselstimes.com/129760/30-of-belgians-not-in-favour-of-getting-coronavirus-vaccine-survey (accessed on 2024-12-16) (Sep. 2020)

  82. [90]

    H. Lyu, J. Wang, W. Wu, V. Duong, X. Zhang, T. D. Dye, J. Luo, Social media study of public opinions on potential COVID-19 vaccines: Informing dissent, disparities, and dissemination, Intelligent Medicine 2 (1) (2022) 1–12. doi: 10.1016/j.imed.2021.08.001. 25

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.