pith. sign in

arxiv: 2604.13381 · v1 · submitted 2026-04-15 · 💻 cs.HC · cs.AI

Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health

Pith reviewed 2026-05-10 13:07 UTC · model grok-4.3

classification 💻 cs.HC cs.AI
keywords youth mental healthgenerative AIchatbotsco-designuser perceptionsmental health servicesAI ethics
0
0 comments X

The pith

Young people want genAI chatbots for mental health that feel human, transparent, timely, and personally controlled.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper explores how young people view conversational generative AI chatbots for mental health support through co-design workshops with 32 participants. It identifies four key themes from their discussions about making such tools acceptable and useful in youth services. A sympathetic reader would care because these perspectives can guide the ethical design and integration of AI into mental health care for young people. The study shows that young people have specific requirements for trust, transparency, appropriateness, and safety in these technologies.

Core claim

By conducting online workshops with 32 young people, the authors developed four themes regarding genAI chatbots in youth mental health: (1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground. These themes offer insights into attitudes, needs, and requirements, with implications for how such chatbots should be reconceptualized for consumers and integrated into services.

What carries the argument

Thematic analysis of co-design workshop data yielding four themes on young people's requirements for genAI chatbots in mental health.

If this is right

  • AI designs must preserve the human aspects of care rather than replace them.
  • Users need clear explanations of how the AI works to build trust.
  • Chatbots should only be used in appropriate contexts and at suitable times.
  • Personalization options should be available but within safe and controlled environments.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • If these themes hold in larger groups, mental health services could use them to set standards for AI chatbot features.
  • Similar co-design methods might help develop AI tools for other sensitive areas like education or social services.
  • Future studies could test whether implementing these recommendations improves actual user engagement and outcomes.

Load-bearing premise

That the perspectives from this small group of Australian young people in workshops can be generalized to other youth and that the co-design process alone ensures the resulting requirements will work effectively in practice.

What would settle it

Conducting similar workshops or surveys with young people from different countries, cultures, or age groups and finding conflicting themes or priorities would indicate the findings are not broadly applicable.

Figures

Figures reproduced from arXiv: 2604.13381 by Adam Poulsen, Carla Gorban, Ebenezer Eyeson-Annan, Elizabeth M. Scott, Frank Iorfino, Haley M. LaMonica, Ian B. Hickie, Jalal Radwan, William Capon, Zsofi de Haan.

Figure 1
Figure 1. Figure 1: Participant demographics 2.2. Reflexive thematic analysis Following reflexive thematic analysis36, four themes were developed from the data: (1) Humanising AI without dehumanising care, (2) I need to know what’s under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
read the original abstract

Conversational generative artificial intelligence agents (or genAI chatbots) could benefit youth mental health, yet young people's perspectives remain underexplored. We examined the Mental health Intelligence Agent (Mia), a genAI chatbot originally designed for professionals in Australian youth services. Following co-design, 32 young people participated in online workshops exploring their perceptions of genAI chatbots in youth mental health and to develop recommendations for reconceptualising Mia for consumers and integrating it into services. Four themes were developed: (1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground. This study offers insights into young people's attitudes, needs, and requirements regarding genAI chatbots in youth mental health, with key implications for service integration. Additionally, by co-designing system requirements, this work informs the ethics, design, development, implementation, and governance of genAI chatbots in youth mental health contexts.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 1 minor

Summary. The paper reports a co-design study involving 32 young people in Australian online workshops who explored perceptions of the Mental health Intelligence Agent (Mia) genAI chatbot and developed recommendations for its adaptation to youth mental health consumers and service integration. It derives four themes—(1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground—and positions the work as providing insights into youth attitudes and requirements with implications for ethics, design, and governance of genAI chatbots.

Significance. If the findings hold, the study offers valuable youth-centered perspectives on an emerging technology in a high-stakes domain, with the co-design element providing a strength by directly informing potential system requirements. This contributes to HCI and mental health literature on responsible AI integration, though the small, Australia-specific sample constrains broader claims about youth needs or direct translatability to service recommendations.

major comments (3)
  1. [Methods] Methods section: The process for developing the four themes from workshop data is not described, including the thematic analysis approach, coding procedures, inter-rater reliability checks, quote selection criteria, or saturation assessment. This directly weakens the central claim that the themes accurately reflect participant perspectives and can inform system requirements.
  2. [Results] Results and participant description: No demographics, recruitment criteria, geographic/cultural diversity details, or inclusion/exclusion criteria are reported for the 32 participants. This undermines the abstract's and discussion's extension of findings to 'young people's perceptions' and 'broader youth needs' in youth mental health.
  3. [Discussion] Discussion: The translation of co-design outputs into 'key implications for service integration' and recommendations for ethics/design/governance lacks any validation steps, pilot testing, or explicit discussion of generalizability limits, making the actionable claims load-bearing but unsupported.
minor comments (1)
  1. [Abstract] Abstract: The claim that the study 'offers insights... with key implications for service integration' could be tempered to reflect the exploratory, small-sample nature until methodological details are added.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for their constructive and detailed review, which has identified key areas for improving the transparency and rigor of our manuscript. We address each major comment below and outline the revisions we will make.

read point-by-point responses
  1. Referee: [Methods] Methods section: The process for developing the four themes from workshop data is not described, including the thematic analysis approach, coding procedures, inter-rater reliability checks, quote selection criteria, or saturation assessment. This directly weakens the central claim that the themes accurately reflect participant perspectives and can inform system requirements.

    Authors: We acknowledge this omission and agree that greater detail is required. In the revised manuscript, we will expand the Methods section to fully describe our reflexive thematic analysis process following Braun and Clarke (2006). This will include the six-phase approach, how initial codes were generated inductively from the workshop transcripts by two researchers, the collaborative process for theme development and refinement (including regular team discussions to resolve differences in interpretation), criteria for selecting representative quotes (ensuring they illustrated the theme while capturing a range of participant voices), and our approach to thematic saturation (iterative analysis until no new themes or sub-themes emerged). We will clarify that formal inter-rater reliability statistics are not standard practice in reflexive thematic analysis, which prioritizes interpretive depth; instead, we relied on a transparent, team-based consensus process. These additions will better substantiate how the themes were derived from the data and support their use in informing system requirements. revision: yes

  2. Referee: [Results] Results and participant description: No demographics, recruitment criteria, geographic/cultural diversity details, or inclusion/exclusion criteria are reported for the 32 participants. This undermines the abstract's and discussion's extension of findings to 'young people's perceptions' and 'broader youth needs' in youth mental health.

    Authors: We agree that this information is essential for contextualizing the findings. We will add a dedicated 'Participants' subsection detailing the recruitment strategy (through Australian youth mental health services and targeted online channels), inclusion criteria (young people aged 16–25 with an interest in mental health and technology), exclusion criteria (e.g., acute distress preventing informed consent), and available demographic characteristics (age range, gender identity distribution, and cultural background where reported). Due to ethical constraints and privacy protections, granular individual-level data were not collected. We will also revise the abstract and discussion to explicitly frame the results as insights from this specific Australian sample rather than broad claims about 'young people's perceptions' or 'broader youth needs,' thereby avoiding overgeneralization. revision: yes

  3. Referee: [Discussion] Discussion: The translation of co-design outputs into 'key implications for service integration' and recommendations for ethics/design/governance lacks any validation steps, pilot testing, or explicit discussion of generalizability limits, making the actionable claims load-bearing but unsupported.

    Authors: We accept this critique and will strengthen the Discussion accordingly. We will add an explicit limitations subsection that addresses generalizability, highlighting the modest sample size, the Australia-specific setting, and the exploratory nature of the co-design workshops. We will clarify that the implications for service integration, ethics, design, and governance are presented as direct outputs from the young people's co-design recommendations and are intended to inform future work rather than as validated or immediately implementable guidelines. We will note that pilot testing and further validation fall outside the scope of this qualitative study but represent important next steps. These changes will ensure the claims are appropriately supported and caveated while preserving the value of the youth-centered insights. revision: yes

Circularity Check

0 steps flagged

No circularity; qualitative thematic analysis from primary workshop data

full rationale

The paper conducts thematic analysis on statements collected directly from 32 young people in online workshops, deriving four themes without any equations, parameter fitting, predictions, or first-principles derivations. No self-citations or prior author work are invoked to justify the central claims; the results rest on the reported participant input and co-design process. This structure is self-contained and exhibits none of the enumerated circularity patterns.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The work rests on standard assumptions of qualitative HCI research rather than new parameters or entities.

axioms (1)
  • domain assumption Thematic analysis of workshop transcripts produces reliable insights into user perceptions
    Invoked implicitly when presenting the four themes as developed from participant input.

pith-pipeline@v0.9.0 · 5523 in / 1116 out tokens · 23804 ms · 2026-05-10T13:07:32.499781+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

4 extracted references · 4 canonical work pages

  1. [1]

    1 McGorry, P . D. The reality of mental health care for young people, and the urgent need for solutions. Medical Journal of Australia. 216, 10.5694/mja2.51327 (2022). 2 McGorry, P . D. et al. The Lancet Psychiatry Commission on youth mental health. Lancet Psychiatry. 11, 10.1016/S2215-0366(24)00163-9 (2024). 3 Weinrabe, A., Tran, J. & Hickie, I. B. Risk t...

  2. [2]

    It happened to be the perfect thing

    Floyd, Kyburz, Penny, Williamson, Julie R., & Sas, Corina) 1-7 (ACM, 2024). 27 Young, J. et al. in CHI Conference on Human Factors in Computing Systems (eds Mueller, Florian Floyd et al.) 1-18 (ACM, 2024). 28 De Freitas, J. & Cohen, I. G. The health risks of generative AI-based wellness apps. Nature Medicine. 30, 10.1038/s41591-024-02943-6 (2024). 29 Brag...

  3. [3]

    36 Braun, V

    Yamashita, Naomi, Evers, Vanessa, Yatani, Koji, & Ding, Xianghua) 1-7 (ACM, 2025). 36 Braun, V . & Clarke, V . in APA handbook of research methods in psychology: Research designs: Quantitative, qualitative, neuropsychological, and biological (eds Cooper, H. et al.) 65-81 (American Psychological Association, 2023). 37 Coeckelbergh, M. Health Care, Capabili...

  4. [4]

    in Proceedings of the 2025 ACM Designing Interactive Systems Conference (eds Nunes, Nuno Jardim et al.) 3132–3152 (ACM, 2025)

    Immersive, Embodied, and Collective Digital Wellbeing Interventions for Healthcare Professionals. in Proceedings of the 2025 ACM Designing Interactive Systems Conference (eds Nunes, Nuno Jardim et al.) 3132–3152 (ACM, 2025). 72 Ortega, A. et al. Co-designing prediction data visualizations for a digital binge eating intervention. Translational Behavioral M...