Pith. sign in

REVIEW 2 major objections 5 minor 41 references

Shots and Boosters: Exploring the Use of Combined Prebunking Interventions to Raise Critical Thinking and Create Long-Term Protection Against Misinformation

T0 review · 2 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Nudging and inoculation should be combined in a two-stage AI-driven intervention to create immediate and lasting resistance to misinformation.

desk verdict A clearly written design proposal whose new idea is the staged combination of inoculation and nudges, not the parts; worth a referee's time, but the AI evaluation of reasoning is a load-bearing assumption with no supporting evidence. read the letter →

arxiv 2505.07486 v1 pith:MK3GRODX submitted 2025-05-12 cs.HC

Huiyun Tang , Anastasia Sergeeva This is my paper · ORCID
classification cs.HC
keywords misinformationprebunkinginoculationtheorynudgingcriticalthinkingmedialiteracyAI-driveninterventionseriousgames
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This position paper argues that the two dominant ways of building misinformation resistance—nudging and inoculation—are not interchangeable but complementary, and that combining them in a single AI-driven intervention would outperform either alone. It proposes a two-stage design: a "vaccination" stage in which players practise judging posts and defend their reasoning to an AI tutor, followed by a "booster" stage of brief, personalized nudges that remind users of their weak spots. A sympathetic reader would care because the combination targets both known failure modes of current approaches: nudges depend on skills users may not have, and inoculation effects fade without reinforcement. If the design works, users would leave with both immediate analytical activation and longer-term "cognitive immunity" that persists after the training ends.

What carries the argument

The carrying mechanism is the pairing of two established intervention logics: inoculation theory—exposing people to weakened forms of misinformation so they build mental resistance to stronger forms later—and nudging, small interface-level prompts that activate analytical thinking. The component that binds them is an AI agent that plays both roles: an intelligent tutor in Stage 1 that evaluates the quality of a user's written reasoning, corrects misconceptions, and stores a strength/weakness profile, and a booster generator in Stage 2 that turns that profile into short, personalized reminders such as "check the credibility and expertise of authority figures." The design also uses a mastery threshold, defined as consistent performance in the game, as the gate between stages, and journalistic codes of conduct as the scoring rubric for the AI's feedback.

What would settle it

Have professional fact-checkers and the AI tutor independently rate the same set of user-written justifications; if agreement is no better than chance, the inoculation stage cannot work as described, because the tutor's corrections and misconception feedback would be unreliable. A second direct check would be whether users who pass the "consistent performance" threshold actually transfer those skills to evaluating real news outside the game.

Watch

Extended reading notes

Core claim

The paper's central claim is that nudging and inoculation should be understood as complementary strategies and combined in a staged, AI-supported training game. Nudging taps immediate, short-term cognitive resources by prompting people to use existing analytical skills, while inoculation builds deeper, longer-term critical thinking and media literacy. The proposed concept operationalizes this as two stages: Stage 1 ("vaccination") is an interactive game where players classify posts as genuine or misleading and must persuade an AI tutor of their reasoning; the tutor evaluates arguments against criteria from professional journalistic practice, corrects misconceptions, and builds a profile of the player's strengths and weaknesses. Once the player shows consistent mastery, Stage 2 ("booster") delivers brief personalized nudges, generated from that profile and applied to current news or the user's own feed, intended to maintain protection with minimal cognitive load. The paper does not report test results; it argues for the design and the reasoning behind it.

Load-bearing premise

The load-bearing premise is that an AI agent can reliably judge the quality of a user's written reasoning and correct their misconceptions; the paper gives no evidence for this capability, and if it fails, both the vaccination training and the personalized boosters lose their foundation.

Editorial extensions

If this is right

  • A user who completes both stages should gain immediate critical-thinking activation from the nudges and longer-lasting media-literacy skills from the inoculation training.
  • Because the booster nudges are generated from the user's stored error profile, protection could be maintained after the formal training ends, addressing the known fade-out of inoculation effects.
  • The same AI profile used for feedback can adapt game difficulty and select exercises, making the intervention personalized rather than one-size-fits-all.
  • If effective, the staged design would reduce reliance on debunking, which only covers a fraction of misinformation, by teaching users to evaluate content independently.
  • The concept gives a concrete template for building AI-supported media-literacy tools, showing where AI tutoring, assessment, and personalized prompting fit into one system.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct randomized comparison—combined two-stage intervention versus inoculation-only, nudge-only, and control—would be the natural test of the paper's complementarity claim; the paper itself proposes the design and does not supply such data.
  • The approach's ceiling is set by how reliably a language model can judge argument quality; a practical next step is measuring agreement between the AI evaluator and professional fact-checkers on the same set of user arguments.
  • The booster schedule hints at a memory-retention curve: optimal timing and content of nudges could be tuned per user, something the paper leaves open.
  • The same two-stage logic could extend beyond news to other misinformation-prone domains such as health claims, where the journalistic criteria would need to be replaced by domain-specific evidentiary standards.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. This position paper argues that fact-checking and debunking are insufficient to counter misinformation and that two complementary intervention families—nudging and inoculation—should be combined. It reviews prior HCI work on short-term AI-supported interventions (e.g., debate chatbots, Socratic questioning) and medium-to-long-term educational interventions (e.g., serious games, AI tutors), and then proposes a two-stage design called "Shots and Boosters." Stage 1 is an inoculation game in which an AI agent evaluates a user's written reasoning, corrects misconceptions, and personalizes exercises; Stage 2 delivers brief, personalized "booster" nudges after training. The paper is explicitly a design concept and contains no empirical evaluation, no implemented prototype, and no formal model. Its central claim is that the two-stage design will improve critical thinking and create long-term protection against misinformation, but this claim is asserted rather than tested.

Significance. If the proposed design were validated, it could make a useful contribution to the misinformation-intervention literature by operationalizing the often-discussed complementarity of short-term activation and longer-term skill building. The paper's strength is its synthesis: it connects inoculation theory, nudging, AI tutoring, and serious games into a coherent design narrative, and it identifies a plausible mechanism whereby personalized reinforcement could extend the effects of an inoculation game. It also honestly frames itself as a position paper rather than an empirical study. However, the design rests on several unvalidated assumptions, the most fragile being that an AI agent can reliably assess the quality of users' written reasoning and decide when mastery is reached. There is no rubric, benchmark, inter-rater validation, or comparison condition. The paper therefore contributes a design concept and a research agenda, not evidence for the effectiveness of the concept.

major comments (2)
  1. [Section 3.1] The abstract and title claim that the proposed interventions "raise critical thinking and create long-term protection against misinformation," but the manuscript contains no empirical test, no pilot data, and no falsifiable prediction. Even as a position paper, the claims should be scoped to match the evidence: the paper should say it proposes a design concept whose effectiveness requires empirical evaluation, and it should specify the evaluation metrics that would be used, such as a validated critical-thinking instrument, a misinformation-discrimination task at immediate and delayed post-tests, and comparison conditions of inoculation-only and nudge-only interventions. Without this, the central claim is not supported by the manuscript's content.
  2. [Section 3.2] The transition from Stage 1 to Stage 2 relies on "consistent performance" as an indicator of mastery, but this criterion is not defined. There is no account of what level or pattern of in-game performance counts as "consistent," how the AI agent would distinguish genuine mastery from gaming the system, or whether in-game performance transfers to real-world news consumption. The booster stage assumes that the user's "strength and weakness profile" is stable and diagnostically valid, but no evidence is given for this assumption. The paper should define the mastery threshold in terms of observable, validated behaviors and specify a transfer-test design (e.g., performance on a separate fake-news detection task with novel exemplars) to support the claim that the intervention creates durable protection.
minor comments (5)
  1. [Keywords] The Additional Key Words and Phrases contain typos: "Miinformation" should be "Misinformation," and "Prebuking" should be "Prebunking."
  2. [Section 3.2] The sentence beginning "Unlike previous stages, which involved extensive interactions with agents" is grammatically incomplete and should be revised.
  3. [References] References [36] and [37] are duplicates of the same Roozenbeek and van der Linden work; one should be removed and the in-text citations adjusted.
  4. [Figures] Figures 1 and 2, both captioned "Presentation of Design concept," appear in the text without visible content in the arXiv version; if the figures are missing or too schematic, they should be replaced with labeled, readable diagrams of the two stages.
  5. [Section 2.1] The definitions of critical thinking, digital literacy, and media literacy are presented briefly; citing the original sources directly (rather than through the HCI secondary source in the critical-thinking definition) would improve clarity.

Circularity Check

0 steps flagged · score 2.0 of 10

No circular derivation; the two-stage design is a position proposal, and the sole self-citation is not load-bearing.

full rationale

This is a position paper proposing a design concept; it contains no equations, fitted parameters, or empirical predictions, so there is no derivation chain that could reduce to its own inputs by construction. The central claim—that nudging and inoculation are complementary and should be combined in a two-stage, AI-driven intervention—is argued from definitions and prior literature rather than derived from the literature it cites. The only self-citation is reference [40] (Tang et al., sharing the present first and co-author), used to support the claim that serious games with AI elements improve misinformation discrimination; however, that sentence is also supported by independent references [37, 39], and the self-cited result is not the sole justification for the new two-stage design. Therefore no circular step is exhibited. The design does rest on an unvalidated assumption about AI evaluation of users' reasoning, but that is a correctness or feasibility risk, not circularity.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

The design concept rests on established behavioral theories from cited prior work and on two unverified assumptions introduced by this paper: that an AI agent can judge reasoning quality, and that combining short- and long-term interventions is more effective than either alone. No numeric parameters are fit.

assumptions (4)
  • domain assumption Exposure to weakened misinformation builds mental resistance (inoculation theory).
    Adopted from cited works [7, 38] and used as the basis for Stage 1.
  • domain assumption Nudging activates existing critical-thinking abilities, not new knowledge.
    Adopted from [13, 25] and used as the basis for Stage 2; implies the user already has sufficient knowledge after training.
  • ad hoc to paper AI agents can evaluate argument quality and personalize learning.
    Assumed in Section 3.1 with reference to journalistic criteria [12], but no evaluation of the AI's assessment accuracy is provided.
  • ad hoc to paper Combining short-term and long-term interventions increases effectiveness.
    The paper asserts complementarity at the end of Section 1, but provides no empirical test of the combined effect.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Shots and Boosters: Exploring the Use of Combined Prebunking Interventions to Raise Critical Thinking and Create Long-Term Protection Against Misinformation." pith.science (2026). https://pith.science/paper/MK3GRODX

@misc{pith2026250507486,
  author       = {Pith},
  title        = {Pith review of: Shots and Boosters: Exploring the Use of Combined Prebunking Interventions to Raise Critical Thinking and Create Long-Term Protection Against Misinformation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MK3GRODX}},
  note         = {Machine review of arXiv:2505.07486}
}
read the original abstract

The problem of how to effectively mitigate the flow of misinformation remains a significant challenge. The classical approach to this is public disapproval of claims or "debunking." The approach is still widely used on social media, but it has some severe limitations in terms of applicability and efficiency. An alternative strategy is to enhance individuals' critical thinking through educational interventions. Instead of merely disproving misinformation, these approaches aim to strengthen users' reasoning skills, enabling them to evaluate and reject false information independently. In this position paper, we explore a combination of intervention methods designed to improve critical thinking in the context of online media consumption. We highlight the role of AI in supporting different stages of these interventions and present a design concept that integrates AI-driven strategies to foster critical reasoning and media literacy.

Figures

Figures reproduced from arXiv: 2505.07486 by the authors.

Figure 1
Figure 1. Presentation of Design concept 3 DESIGN CONCEPT Our proposed AI-driven intervention is designed as an interactive training game structured into two complementary stages, combining elements of inoculation theory and nudging. The training leverages AI’s capacity for personalized interactions to enhance critical thinking and media literacy [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. Presentation of Design concept 3.1 Stage 1: Inoculation Training ("Vaccination") In the first stage, users participate in a simulated "vaccination" experience against misinformation through an interactive game. Players encounter various potentially misleading posts or news articles and must determine whether each is genuine information or not. The player also needs to write their reasoning in conversation with an AI… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

41 extracted references · 33 canonical work pages

  1. [1]

    Harmony Square: A Political Disinformation Game

    2020. Harmony Square: A Political Disinformation Game. https://harmonysquare.game. Accessed: 2024-09-09

    work page 2020

  2. [2]

    Patricia Aufderheide. 2018. Media literacy: From a report of the national leadership conference on media literacy. In Media Literacy Around the World. Routledge, 79–86

    work page 2018

  3. [3]

    David Bawden et al. 2008. Origins and concepts of digital literacy. Digital literacies: Concepts, policies and practices 30, 2008 (2008), 17–32

    work page 2008

  4. [4]

    Mohammad Hassan Yousif Binhammad, Azzam Othman, Laila Abuljadayel, Huda Al Mheiri, Muna Alkaabi, and Mohammad Almarri. 2024. Investigating how generative AI can create personalized learning materials tailored to individual student needs. Creative Education 15, 7 (2024), 1499–1523

    work page 2024

  5. [5]

    Yuwei Chuai, Anastasia Sergeeva, Gabriele Lenzini, and Nicolas Pröllochs. 2024. Community Fact-Checks Trigger Moral Outrage in Replies to Misleading Posts on Social Media. arXiv preprint arXiv:2409.08829 (2024)

    arXiv 2024

  6. [6]

    Yuwei Chuai, Haoye Tian, Nicolas Pröllochs, and Gabriele Lenzini. 2024. Did the Roll-Out of Community Notes Reduce Engagement With Misinformation on X/Twitter? Proceedings of the ACM on Human-Computer Interaction 8, CSCW2 (2024), 1–52. Shots and Boosters: Exploring the Use of Combined Prebunking Interventions to Raise Critical Thinking and Create Long-Ter...

    work page 2024

  7. [7]

    Josh Compton, Sander van der Linden, John Cook, and Melisa Basol. 2021. Inoculation theory in the post-truth era: Extant findings and new frontiers for contested science, misinformation, and conspiracy theories. Social and Personality Psychology Compass 15, 6 (2021), e12602

    work page 2021

  8. [8]

    Theodora Dame Adjin-Tettey. 2022. Combating fake news, disinformation, and misinformation: Experimental evidence for media literacy education. Cogent arts & humanities 9, 1 (2022), 2037229

    work page 2022

Show all 41 references
  1. [9]

    Valdemar Danry, Pat Pataranutaporn, Yaoli Mao, and Pattie Maes. 2023. Don’t just tell me, ask me: Ai systems that intelligently frame explanations as questions improve human logical discernment accuracy over causal ai explanations. In Proceedings of the 2023 CHI Conference on ...

    2023

  2. [10]

    Ullrich KH Ecker, Stephan Lewandowsky, John Cook, Philipp Schmid, Lisa K Fazio, Nadia Brashier, Panayiota Kendeou, Emily K Vraga, and Michelle A Amazeen. 2022. The psychological drivers of misinformation belief and its resistance to correction. Nature Reviews Psychology 1, 1 (...

    2022

  3. [11]

    Ziv Epstein, Gordon Pennycook, and David Rand. 2020. Will the crowd game the algorithm? Using layperson judgments to combat misinformation on social media by downranking distrusted sources. In Proceedings of the 2020 CHI conference on human factors in computing systems . 1–11

    2020

  4. [12]

    European Commission. 2025. The Code of Conduct on Disinformation. https://digital-strategy.ec.europa.eu/en/library/code-conduct-disinformation. https://digital-strategy.ec.europa.eu/en/library/code-conduct-disinformation Accessed: 2025-04-18

    2025

  5. [13]

    Lisa Fazio. 2020. Pausing to consider why a headline is true or false can help reduce the sharing of false news.Harvard Kennedy School Misinformation Review 1, 2 (2020)

    2020

  6. [14]

    Council for Aid to Education. 2014. CLA+: Technical FAQ. http://www.cae.org/. New York, NY: Author

    2014

  7. [15]

    Melanie Freeze, Mary Baumgartner, Peter Bruno, Jacob R Gunderson, Joshua Olin, Morgan Quinn Ross, and Justine Szafran. 2021. Fake claims of fake news: Political misinformation, warnings, and the tainted truth effect. Political behavior 43 (2021), 1433–1465

    2021

  8. [16]

    Lucas Graves and Michelle Amazeen. 2019. Fact-checking as idea and practice in journalism. (2019)

    2019

  9. [17]

    Zhijiang Guo, Michael Schlichtkrull, and Andreas Vlachos. 2022. A survey on automated fact-checking. Transactions of the Association for Computational Linguistics 10 (2022), 178–206

    2022

  10. [18]

    Gusmanson.nl. 2022. Cat Park is a game about disinformation. join the opposition to the cat park! https://catpark.game/

    2022

  11. [19]

    Donald Hatcher and Kevin Possin. [n. d.]. Thinking Critically about Critical-Thinking Assessment. ([n. d.])

  12. [20]

    Benjamin D Horne, Dorit Nevo, John O’Donovan, Jin-Hee Cho, and Sibel Adalı. 2019. Rating reliability and bias in news articles: Does AI assistance help everyone?. In Proceedings of the International AAAI Conference on Web and Social Media , Vol. 13. 247–256

    2019

  13. [21]

    William Huitt. 1998. Critical thinking: An overview. Educational Psychology Interactive. Valdosta, GA: Valdosta State University (1998)

    1998

  14. [22]

    Youngseung Jeon, Bogoan Kim, Aiping Xiong, Dongwon Lee, and Kyungsik Han. 2021. Chamberbreaker: Mitigating the echo chamber effect and supporting information hygiene through a gamified inoculation system. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–26

    2021

  15. [23]

    Maher Joe Khan Omar Jian. 2023. Personalized learning through AI. Advances in Engineering Innovation 5 (2023), 16–19

    2023

  16. [24]

    Anastasia Katsaounidou, Lazaros Vrysis, Rigas Kotsakis, Charalampos Dimoulas, and Andreas Veglis. 2019. MAthE the game: A serious game for education and training in news verification. Education Sciences 9, 2 (2019), 155

    2019

  17. [25]

    Anastasia Kozyreva, Philipp Lorenz-Spreen, Stefan M Herzog, Ullrich KH Ecker, Stephan Lewandowsky, Ralph Hertwig, Ayesha Ali, Joe Bak- Coleman, Sarit Barzilai, Melisa Basol, et al. 2024. Toolbox of individual-level interventions against online misinformation. Nature Human Beha...

    2024

  18. [26]

    Emily R Lai. 2011. Critical thinking: A literature review. Pearson’s Research Reports 6, 1 (2011), 40–41

    2011

  19. [27]

    Vivian Lai and Chenhao Tan. 2019. On human predictions with explanations and predictions of machine learning models: A case study on deception detection. In Proceedings of the conference on fairness, accountability, and transparency . 29–38

    2019

  20. [28]

    Joanne Leong, Pat Pataranutaporn, Valdemar Danry, Florian Perteneder, Yaoli Mao, and Pattie Maes. 2024. Putting things into context: Generative AI-enabled context personalization for vocabulary learning improves learning motivation. In Proceedings of the 2024 CHI Conference on...

    2024

  21. [29]

    Stephan Lewandowsky, Ullrich KH Ecker, Colleen M Seifert, Norbert Schwarz, and John Cook. 2012. Misinformation and its correction: Continued influence and successful debiasing. Psychological science in the public interest 13, 3 (2012), 106–131

    2012

  22. [30]

    Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Shuming Shi, and Zhaopeng Tu. 2023. Encouraging divergent thinking in large language models through multi-agent debate. arXiv preprint arXiv:2305.19118 (2023)

    2023 arXiv

  23. [31]

    Nicholas Micallef, Vivienne Armacost, Nasir Memon, and Sameer Patil. 2022. True or false: Studying the work practices of professional fact-checkers. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1–44

    2022

  24. [32]

    Irina Paraschivoiu, Josef Buchner, Robert Praxmarer, and Thomas Layer-Wagner. 2021. Escape the fake: Development and evaluation of an augmented reality escape room game for fighting fake news. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in ...

    2021

  25. [33]

    Saumya Pareek, Niels van Berkel, Eduardo Velloso, and Jorge Goncalves. 2024. Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment. Proceedings of the ACM on Human-Computer Interaction CSCW (2024)

    2024

  26. [34]

    Jorge-Andrick Parra-Valencia and Martha-Lizette Massey. 2023. Leveraging AI Tools for Enhanced Digital Literacy, Access to Information, and Personalized Learning. In Managing Complex Tasks with Systems Thinking . Springer, 213–234. 8 Tang et al

    2023

  27. [35]

    Pat Pataranutaporn, Valdemar Danry, Joanne Leong, Parinya Punpongsanon, Dan Novy, Pattie Maes, and Misha Sra. 2021. AI-generated characters for supporting personalized learning and well-being. Nature Machine Intelligence 3, 12 (2021), 1013–1022

    2021

  28. [37]

    Jon Roozenbeek and Sander Van der Linden. 2019. Fake news game confers psychological resistance against online misinformation. Palgrave Communications 5, 1 (2019), 1–10

    2019

  29. [38]

    Neeraj Soni. 2024. ‘Prebunking’: An Effective Approach to Combat Misinformation. CyberPeace. https://www.cyberpeace.org/resources/blogs/ prebunking-an-effective-approach-to-combat-misinformation

    2024

  30. [39]

    Haoheng Tang and Mrinalini Singha. 2024. A Mystery for You: A fact-checking game enhanced by large language models (LLMs) and a tangible interface. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems . 1–5

    2024

  31. [40]

    Huiyun Tang, Songqi Sun, Kexin Nie, Ang Li, Anastasia Sergeeva, and Ray LC. 2025. Breaking the News: A LLM-based Game where Players Act as Influencer or Debunker for Raising Awareness About Misinformation. arXiv preprint arXiv:2502.04931 (2025)

    2025

  32. [41]

    Thitaree Tanprasert, Sidney S Fels, Luanne Sinnamon, and Dongwook Yoon. 2024. Debate chatbots to facilitate critical thinking on youtube: Social identity and conversational style make a difference. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems . 1–24

    2024

  33. [42]

    Liudmila Zavolokina, Kilian Sprenkamp, Zoya Katashinskaya, Daniel Gordon Jones, and Gerhard Schwabe. 2024. Think fast, think slow, think critical: designing an automated propaganda detection tool. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems . 1–24

    2024

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.