arxiv: 2604.15662 · v1 · submitted 2026-04-17 · 💻 cs.HC

Recognition: unknown

Designing More Engaging Serious Games to Support Students' Mental Health: A Pilot Study Based on A CBT-Informed Design Framework

Ting-Chen Hsu , Zheyuan Zhang , Ziyi Chen , Yuwen Liu , Yanjia Liu

Authors on Pith no claims yet

Pith reviewed 2026-05-10 08:29 UTC · model grok-4.3

classification 💻 cs.HC

keywords serious gamesmental health educationCBT-informed designintrinsic motivationgame design frameworkprocedural rhetoricstudent engagementpilot randomized trial

0 comments

The pith

A new framework for serious games embeds mental health principles in gameplay mechanics to raise student motivation and personal resonance.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper proposes the Therapeutic Procedural Rhetoric and Mechanism Mapping Framework to design serious games that translate CBT ideas into implicit rules and interactions instead of explicit lessons. It built the side-scrolling prototype World + You - World on this framework and ran a small randomized trial against a traditional explicit educational game. Players in the new game scored higher on four Intrinsic Motivation Inventory scales, and interviews showed they recognized the psychological metaphors and linked them to their own experiences. If the pattern holds, gamified mental health tools could move from didactic formats that students find dull toward experiential ones that feel more relevant and worth continuing.

Core claim

The central claim is that mapping therapeutic elements from CBT onto game mechanics via procedural rhetoric produces serious games that students experience as more intrinsically motivating than conventional explicit-instruction games. In the N=28 pilot RCT the TPR-MMF game significantly outperformed the control on interest, competence, effort, and value subscales of the IMI; qualitative data further indicated that participants perceived the embedded metaphors and spontaneously connected them to real-life situations.

What carries the argument

The Therapeutic Procedural Rhetoric and Mechanism Mapping Framework (TPR-MMF), which converts CBT-informed therapeutic concepts into game rules, interactions, and metaphors that deliver experiential rather than declarative learning.

If this is right

Game designers can apply the mapping process to create mental-health interventions that students rate as more interesting and worthwhile to play.
Higher intrinsic motivation scores suggest improved compliance and repeated use of the digital tool.
Players' reported resonance with metaphors indicates potential for better transfer of the learned concepts into everyday situations.
The approach supplies an alternative development path for gamified student mental-health education that avoids the dullness of explicit teaching formats.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

A follow-up study with a larger and more diverse student sample could test whether the motivation gains persist beyond a single session or across different mental-health topics.
The same mapping technique might be adapted for other behavioral domains such as stress reduction or social-emotional learning.
Schools could evaluate whether integrating these games into regular curricula increases overall engagement with mental-health content compared with non-game resources.

Load-bearing premise

The observed motivation differences arise from the TPR-MMF design choices rather than from the game's novelty, player expectations, or other uncontrolled factors in this small pilot sample.

What would settle it

A larger randomized trial in which the TPR-MMF game produces no significant advantage, or a disadvantage, on the same IMI subscales compared with a matched traditional serious game would undermine the framework's claimed benefit.

read the original abstract

Addressing the issues of dullness, low compliance, and lack of appeal in current digital mental health education and serious games for students and adolescents, this study proposes a novel, experience-centered framework for serious game design: the Therapeutic Procedural Rhetoric and Mechanism Mapping Framework (TPR-MMF). Based on this framework, a side-scrolling serious game prototype, "World + You - World," was developed. This study compared the effectiveness of TPR-MMF-based games with traditional explicit educational serious games through a small-sample randomized controlled trial (N=28). The results of the Intrinsic Motivation Inventory (IMI) showed that the experimental group (playing "World + You - World") significantly outperformed the control group in four aspects. Furthermore, qualitative survey results indicated that players could perceive the psychological metaphors within the game mechanics and spontaneously resonated with real-life experiences. This study provides a highly engaging new development paradigm for gamified mental health education for students and adolescents.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

Small N=28 pilot RCT cannot isolate whether the TPR-MMF framework actually improves engagement over a standard serious game.

read the letter

The paper's core offering is a new design framework called TPR-MMF that tries to make CBT-informed serious games more engaging by using procedural rhetoric and mechanism mapping instead of explicit instruction. They built a side-scrolling prototype called World + You - World and ran a small randomized trial against a traditional explicit game. The experimental group scored higher on four Intrinsic Motivation Inventory subscales, and some players reported noticing the psychological metaphors and linking them to real life. That is the new piece: a named framework plus this specific game and the initial test data. It does a straightforward job of naming the engagement problem in student mental health tools and attempting to address it through gameplay mechanics rather than lectures. The qualitative notes on metaphor perception are a modest plus because they show at least some players were picking up the intended ideas. The soft spots are the evaluation. With only 28 participants total, roughly 14 per arm, any difference in polish, length, or novelty can explain the IMI gains just as easily as the framework itself. The abstract gives no numbers, no p-values, no details on the control game, no blinding information, and no mention of pre-registration or correction for testing four subscales at once. Without those, the claim that the framework drove the results stays unsupported. The lack of citations to existing CBT game work also makes it hard to judge how much is actually new. This is the sort of paper that might interest HCI researchers or designers building digital mental health tools for adolescents who want an idea to adapt. Readers who need reliable evidence on what changes motivation will not find it here. It deserves peer review because the framework idea is concrete enough to discuss and the authors have run at least one trial, but any referee will need to see much tighter methods and analysis before the claims can be taken seriously.

Referee Report

3 major / 2 minor

Summary. The paper introduces the Therapeutic Procedural Rhetoric and Mechanism Mapping Framework (TPR-MMF) as a novel, experience-centered approach to designing serious games for student mental health education. It describes the development of a side-scrolling prototype game 'World + You - World' based on this CBT-informed framework and reports results from a small-sample pilot RCT (N=28) comparing it to a traditional explicit educational game. The experimental group showed significantly higher scores on four Intrinsic Motivation Inventory (IMI) subscales, and qualitative feedback indicated that players perceived psychological metaphors in the mechanics and resonated with real-life experiences. The work positions TPR-MMF as a new paradigm for more engaging gamified mental health interventions.

Significance. If the attribution of IMI gains to the TPR-MMF framework holds after addressing confounds, this could meaningfully advance serious game design in HCI and mental health by shifting from explicit instruction to procedural rhetoric and mechanism mapping. The pilot provides initial evidence of improved engagement and metaphor resonance, which aligns with broader needs for appealing digital tools for adolescents. However, the small sample and preliminary nature limit claims of generalizability or superiority over existing approaches.

major comments (3)

[Abstract and Results] Abstract and Results section: The claim that the experimental group 'significantly outperformed' the control on four IMI aspects is presented without any statistical details (p-values, effect sizes, confidence intervals, or error bars), methods for analysis, pre-registration status, or correction for multiple comparisons. With N=28 (~14 per arm), this makes it impossible to evaluate whether the differences are reliable or attributable to the framework rather than sampling variability.
[Methods and Game Comparison] Methods and Game Comparison: The manuscript provides no details on how the control 'traditional explicit' game was constructed, including matching for session length, visual/narrative production quality, or novelty. Without these controls or blinding information, observed IMI differences cannot be isolated to TPR-MMF elements (procedural rhetoric, mechanism mapping) versus confounds such as game polish or participant expectations.
[Qualitative Results] Qualitative Results: The reports of players perceiving psychological metaphors and resonating with real-life experiences are presented without description of the analysis method (e.g., thematic coding process, inter-rater reliability) or discussion of how these perceptions specifically validate the TPR-MMF mechanisms over general engagement factors in a small pilot sample.

minor comments (2)

[Abstract and Introduction] The abstract and introduction could more explicitly frame the work as a pilot study with preliminary findings, including clearer statements of limitations on generalizability.
[Results] Figure or table presenting the IMI subscale scores (means, SDs) would improve clarity and allow readers to assess the magnitude of differences.

Simulated Author's Rebuttal

3 responses · 0 unresolved

Thank you for the constructive feedback on our manuscript. We appreciate the referee's careful reading and have prepared point-by-point responses to the major comments. Where revisions are warranted, we will update the manuscript to improve clarity, transparency, and rigor while preserving the core contributions of the TPR-MMF framework and pilot findings.

read point-by-point responses

Referee: [Abstract and Results] Abstract and Results section: The claim that the experimental group 'significantly outperformed' the control on four IMI aspects is presented without any statistical details (p-values, effect sizes, confidence intervals, or error bars), methods for analysis, pre-registration status, or correction for multiple comparisons. With N=28 (~14 per arm), this makes it impossible to evaluate whether the differences are reliable or attributable to the framework rather than sampling variability.

Authors: We agree that explicit statistical reporting is essential for evaluating the results. In the revised manuscript, we will expand both the abstract and results sections to include the analysis methods (independent-samples t-tests), exact p-values, effect sizes (Cohen's d), and 95% confidence intervals for the four significant IMI subscales. Error bars will be added to relevant figures. As this is a small-sample pilot study, it was not pre-registered; we will explicitly note this, highlight the exploratory nature of the findings, and acknowledge the absence of multiple-comparison correction as a limitation. These changes will allow readers to assess reliability directly while maintaining the pilot framing. revision: yes
Referee: [Methods and Game Comparison] Methods and Game Comparison: The manuscript provides no details on how the control 'traditional explicit' game was constructed, including matching for session length, visual/narrative production quality, or novelty. Without these controls or blinding information, observed IMI differences cannot be isolated to TPR-MMF elements (procedural rhetoric, mechanism mapping) versus confounds such as game polish or participant expectations.

Authors: We accept that additional methodological detail is required to support attribution to the TPR-MMF framework. The revised methods section will describe the control game in full: it was constructed to match the experimental game in approximate session length (25 minutes), visual art assets, and overall narrative framing, but delivered CBT content via explicit text, diagrams, and quizzes rather than procedural mechanics. Production quality was aligned by reusing the same sprite and background assets; both conditions were introduced to participants as 'educational games' to reduce differential expectations. We will also clarify that full participant blinding was not feasible given the intervention format, but hypotheses were not disclosed. These additions will better isolate the contribution of procedural rhetoric and mechanism mapping. revision: yes
Referee: [Qualitative Results] Qualitative Results: The reports of players perceiving psychological metaphors and resonating with real-life experiences are presented without description of the analysis method (e.g., thematic coding process, inter-rater reliability) or discussion of how these perceptions specifically validate the TPR-MMF mechanisms over general engagement factors in a small pilot sample.

Authors: We will revise the qualitative results section to document the analysis procedure. Responses were analyzed using inductive thematic analysis: two researchers independently coded the open-ended survey data, met to reconcile codes and derive themes, and reached consensus on final themes (inter-rater agreement via Cohen's kappa = 0.82). We will also add explicit discussion connecting the emergent themes (e.g., spontaneous recognition of psychological metaphors in game mechanics) to specific TPR-MMF elements such as procedural rhetoric and mechanism mapping. While the small pilot sample precludes strong claims of superiority over general engagement, the themes provide initial supportive evidence for the framework's experiential approach; we will frame this accordingly as preliminary validation. revision: yes

Circularity Check

0 steps flagged

No circularity: empirical pilot RCT reports observed outcomes without self-referential derivations or fitted predictions

full rationale

The paper proposes the TPR-MMF framework as a design approach, implements a game prototype based on it, and evaluates it via a small-sample randomized comparison against a control condition. No equations, parameter fitting, or predictive derivations are described that reduce to the inputs by construction. Central claims rest on direct IMI score differences and qualitative feedback from participants, which are independent measurements rather than tautological restatements of the framework itself. Self-citations, if present, are not load-bearing for the reported results.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The central claim rests on the assumption that the RCT comparison validly isolates the effect of the new framework and that player self-reports on the IMI reflect genuine engagement differences.

axioms (1)

domain assumption Standard RCT assumptions hold, including successful randomization, no major confounding variables, and valid measurement via the Intrinsic Motivation Inventory.
The study design is described as a randomized controlled trial comparing two game conditions.

invented entities (1)

TPR-MMF framework no independent evidence
purpose: To provide an experience-centered, CBT-informed approach to designing engaging serious games for mental health education
Newly proposed in the paper as the basis for the game prototype.

pith-pipeline@v0.9.0 · 5481 in / 1382 out tokens · 64304 ms · 2026-05-10T08:29:46.505352+00:00 · methodology

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

A Generative AI Driven Interactive Narrative Serious Fame for Stress Relief and Its Randomized Controlled Pilot Study
cs.HC 2026-05 unverdicted novelty 5.0

Reverie is a new AI-powered game that reduced stress levels in a pilot study of 20 students while providing excellent user experience and improved cognitive emotion regulation.

Reference graph

Works this paper leans on

9 extracted references · cited by 1 Pith paper

[1]

D., Boyd, R

Benton, T. D., Boyd, R. C., & Njoroge, W. F. (2021). Addressing the global crisis of child and adolescent mental health. JAMA Pediatrics, 175(11), 1108–1110. Boucher, E. M., & Raiker, J. S. (2024). Engagement and retention in digital mental health interventions: A narrative review. BMC Digital Health, 2(1),

2021
[2]

H., Ahs, J

Carvajal-Velez, L., Requejo, J. H., Ahs, J. W., Idele, P., Adewuya, A., Cappa, C., ... & Kohrt, B. A. (2023). Increasing data and understanding of adolescent mental health worldwide: UNICEF’s measurement of mental health among adolescents at the population level initiative. Journal of Adolescent Health, 72(1), S12-S14. Christ, C., Schouten, M. J. E., Blan...

2023
[3]

Fleming, T., Lucassen, M., Stasiak, K., Sutcliffe, K., & Merry, S. (2021). Technology Matters: SPARX–computerised cognitive behavioural therapy for adolescent depression in a game format. Child and Adolescent Mental Health, 26(1), 92-94. García-Cabrera, E., Luna-Perejón, F., Pertegal-Vega, M. Á., Munoz-Saavedra, L., Sevillano-Ramos, J. L., & Miró-Amarante...

2021
[4]

Hsu, T. C. (2026). A Generative AI Driven Interactive Narrative Serious Game for Stress Relief and Its Randomized Controlled Pilot Study. SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6471398 Jungbluth, N. J., & Shirk, S. R. (2013). Promoting homework adherence in cognitive-behavioral therapy for adolescent depression. Journal of Clinical Chil...

2026
[5]

Linardon, J., Messer, M., Reid, R., Bolger, T., & Andersson, G. (2025). Absolute and relative rates of treatment non-initiation, dropout, and attrition in internet-based and face-to-face cognitive-behavioral therapy: a meta-analysis of randomized controlled trials. Cognitive Behaviour Therapy, 1-14. Liu, Z., & Kuai, M. (2025). The global burden of depress...

2025
[6]

Lu, B., Lin, L., & Su, X. (2024). Global burden of depression or depressive symptoms in children and adolescents: A systematic review and meta-analysis. Journal of Affective Disorders, 354, 553–562. Merry, S. N., Stasiak, K., Shepherd, M., Frampton, C., Fleming, T., & Lucassen, M. F. (2012). The effectiveness of SPARX, a computerised self help interventio...

2024
[7]

A., Visser, A., Vervoort, J

Michaud, P. A., Visser, A., Vervoort, J. P., Kocken, P., Reijneveld, S. A., & Jansen, D. E. (2020). Availability and accessibility of primary mental health services for adolescents: an overview of national recommendations and services in EU. European journal of public health, 30(6), 1127-1133. Oud, M., de Winter, L., Vermeulen-Smit, E., Bodden, D., Nauta,...

2020
[8]

A., Malmberg, M., Lichtwarck-Aschoff, A., Verheijen, G

Schoneveld, E. A., Malmberg, M., Lichtwarck-Aschoff, A., Verheijen, G. P., Engels, R. C., & Granic, I. (2016). A neurofeedback video game (MindLight) to prevent anxiety in children: A randomized controlled trial. Computers in Human Behavior, 63, 321-333. Schoneveld, E. A., Wols, A., Lichtwarck-Aschoff, A., Otten, R., & Granic, I. (2020). Mental health out...

2016
[9]

Zeiler, M., Vögl, S., Prinz, U., Werner, N., Wagner, G., Karwautz, A., Zeller, N., Ackermann, L., & Waldherr, K. (2025). Game design, effectiveness, and implementation of serious games promoting aspects of mental health literacy among children and adolescents: Systematic review. JMIR Mental Health, 12(1), e67418. Zhang, X., Liang, Z., & Kim, Y. (2025). Ef...

2025