Benefits and Harms of Large Language Models in Digital Mental Health
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:YGIKYMM2record.jsonopen to challenge →
read the original abstract
The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for valuable insights into patient experiences, promising early, proactive interventions, as well as personalized treatment plans. Recent developments in generative artificial intelligence, particularly large language models (LLMs), show promise in leading digital mental health to uncharted territory. Patients are arriving at doctors' appointments with information sourced from chatbots, state-of-the-art LLMs are being incorporated in medical software and EHR systems, and chatbots from an ever-increasing number of startups promise to serve as AI companions, friends, and partners. This article presents contemporary perspectives on the opportunities and risks posed by LLMs in the design, development, and implementation of digital mental health tools. We adopt an ecological framework and draw on the affordances offered by LLMs to discuss four application areas -- care-seeking behaviors from individuals in need of care, community care provision, institutional and medical care provision, and larger care ecologies at the societal level. We engage in a thoughtful consideration of whether and how LLM-based technologies could or should be employed for enhancing mental health. The benefits and harms our article surfaces could serve to help shape future research, advocacy, and regulatory efforts focused on creating more responsible, user-friendly, equitable, and secure LLM-based tools for mental health treatment and intervention.
This paper has not been read by Pith yet.
Forward citations
Cited by 8 Pith papers
-
The Impact of Security and Privacy Controls on Users' Emotional Engagement with Generative AI Chatbots
In a vignette study of 354 U.S. participants, deletion-based privacy controls outperformed all other controls in increasing willingness to engage with GenAI chatbots for emotional support, while technically complex co...
-
When AI Says "I have been in similar situations": Synthetic Lived Experience in Peer-Like Caregiver Support
LLMs prompted as peer supporters for ADRD caregivers produce synthetic lived experience through narrative language that differs from human peers in first-person and past-tense usage, revealing a narrative authenticity gap.
-
The TEA Nets framework combines AI and cognitive network science to model targets, events and actors in text
TEA Nets extracts agents, events, and targets from text to reveal emotional and semantic patterns in conspiracy theories and psychotherapy transcripts from humans and LLMs.
-
One Year Later...The Harms Persist, But So Do We!
Evaluation of eight LLMs across 16 DSM-5 conditions shows safety guardrails succeed only for suicide/self-harm while failing at rates up to 100% for other clinical issues, supported by a new eight-dimension harm taxonomy.
-
One Year Later...The Harms Persist, But So Do We!
LLM safety guardrails fail for most mental health conditions with up to 100% failure rates for eating disorders, substance use disorder, and major depressive disorder, while holding only for suicide and self-harm.
-
Analyzing LLM Reasoning to Uncover Mental Health Stigma
Analyzing intermediate reasoning in LLMs reveals substantially more mental health stigma than MCQ evaluations by using clinical categories to tag and rate problematic statements.
-
One Year Later...The Harms Persist, But So Do We!
Six proprietary LLMs were tested across 16 DSM-5 conditions with four adversarial variants; safeguards succeeded only for suicide/self-harm while failing at high rates for eating disorders, substance use, and major de...
-
AI Content Moderation in Therapy Conversations
An algorithm audit finds that OpenAI moderation, Llama Guard, and Shield Gemma frequently flag content from real therapy sessions as undesirable.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.