REVIEW
AI emotional support is better only when chosen, but shifts preferences even when it is not
Artificial Intelligence · Submitted 24 Aug 2026 · 43 references
Pith's verdict: A genuinely new moderation result with a real length-imbalance confound; worth refereeing but not accepting as-is.
T0 · AI review
Why Pith says this
Highlight any text to comment on it.
Referee report
The paper
The paper claims
The paper argues that AI emotional support is rated as superior to human support only when the recipient initially chose AI, and that even unchosen AI interactions shift future preference toward AI.
The reading
What carries the argument
The engine of the design is choice-assignment congruence: participants state a preference for a human or AI partner, then are randomly assigned to either the chosen or unchosen partner, so the same conversation can be examined with and without the filter of choice. The mechanisms that carry the argument are the four belief dimensions, emotional support, nonjudgment, confidentiality, and advice quality, measured before and after the interaction, plus repeated measures of partner choice. In Study 4, the machinery is a 3x3 randomized longitudinal design crossing conversation topic (personal, non-personal, open-ended) with modality, with daily five-minute ChatGPT conversations over 28 days.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is that the `AI is more empathic` effect found in prior work is conditional on choice. Choice congruence, getting the partner you initially selected, raised experienced empathy, enjoyment, satisfaction, and desire to continue, but only among participants assigned to AI; among those assigned to a human, congruence had no measurable effect. As a consequence, AI was rated superior to human support only in the cell where participants chose AI and then chatted with AI. The same conversations updated beliefs: chatting with AI raised post-conversation ratings of AI's emotional support and nonjudgment regardless of initial choice, and chatting with AI predicted choosing AI for future sharing. The longitudinal study extends this to naturalistic use: 28 days of daily ChatGPT conversations increased AI preference for personal issues from 25.4% to 31.9% and reduced human preference from 82.1% to 76.5%, with the change concentrated in conditions where conversations were personal or open-ended.
Load-bearing premise
The load-bearing premise is that the human-listener condition is a fair active control for the AI, yet human listeners averaged about 14.7 words per turn while the AI averaged 56.6, so the `AI only better when chosen` result could reflect long polished messages rather than the source itself.
Editorial extensions
If this is right
- AI superiority in short empathic messages is not a general property of AI responses; it depends on the recipient having chosen AI in the first place.
- A single five-minute conversation with an AI, even when the participant had wanted a human, increased the likelihood of choosing AI for a future emotional conversation.
- A month of daily AI use that turns personal or open-ended shifts stated partner preference away from humans, while non-personal task use leaves preferences essentially unchanged.
- Emotionally engaging behaviors, such as AI validation, expressed empathy, and users' self-disclosure and support seeking, predict the shift toward AI and away from human preference.
Reading between the lines
- A testable extension of the paper's design would match human listeners' response length to the AI's, since the reported averages of roughly 15 versus 57 words per turn leave open whether the `chosen AI` advantage comes from longer, more polished messages rather than the source itself.
- If the human alternative were a close friend or therapist rather than a stranger, the path-dependent shift toward AI might be weaker; that boundary is not tested in these studies.
- The Study 4 preference measure is self-reported, so a natural next test is whether the observed shift in stated preference actually changes whom people turn to for support in their daily lives.
Original abstract
People increasingly face a novel decision when seeking emotional support: human or AI. In existing studies, AI's empathic messages are rated as well as or better than humans'. But these studies either assigned the support source or honored people's choice. In real life, support is often incongruent with choice, as people want one source and receive the other. Across three experiments (N = 1,951), participants chose whether to share an emotional experience with a human or an AI, then were randomly assigned to a congruent or incongruent partner. AI support was rated as superior only among those who had chosen it. Yet regardless of congruence, interacting with AI increased willingness to choose it again. In a 28-day study with OpenAI (N = 981), daily conversations shifted preferences toward AI and away from humans, but only when conversations turned personal. Emotional support choices are thus path-dependent, progressively redirecting away from human connection.
The compiled record
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
The abstract, sentence by sentence
People increasingly face a novel decision when seeking emotional support: human or AI. In existing studies, AI's empathic messages are rated as well as or better than humans'. But these studies either assigned the support source or honored people's choice. In real life, support is often incongruent with choice, as people want one source and receive the other. Across three experiments (N = 1,951), participants chose whether to share an emotional experience with a human or an AI, then were randomly assigned to a congruent or incongruent partner. AI support was rated as superior only among those who had chosen it. Yet regardless of congruence, interacting with AI increased willingness to choose it again. In a 28-day study with OpenAI (N = 981), daily conversations shifted preferences toward AI and away from humans, but only when conversations turned personal. Emotional support choices are thus path-dependent, progressively redirecting away from human connection.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | People increasingly face a novel decision when seeking emotional support: human or AI. | background 1.00 | 0.06 | 0.02 | asserted 0.99 |
| s1 | In existing studies, AI's empathic messages are rated as well as or better than humans'. | background 1.00 | 0.03 | 0.03 | asserted 1.00 |
| s2 | But these studies either assigned the support source or honored people's choice. | gap 0.96 | 0.06 | 0.02 | asserted 0.99 |
| s3 | In real life, support is often incongruent with choice, as people want one source and receive the other. | gap 0.72 | 0.08 | 0.05 | asserted 0.94 |
| s4 | Across three experiments (N = 1,951), participants chose whether to share an emotional experience with a human or an AI, then were randomly assigned to a congruent or incongruent partner. | method 0.97 | 0.95 | 0.04 | asserted 0.98 |
| s5 | AI support was rated as superior only among those who had chosen it. | result 1.00 | 0.92 | 0.28 | asserted 1.00 |
| s6 | Yet regardless of congruence, interacting with AI increased willingness to choose it again. | result 1.00 | 0.92 | 0.17 | asserted 1.00 |
| s7 | In a 28-day study with OpenAI (N = 981), daily conversations shifted preferences toward AI and away from humans, but only when conversations turned personal. | result 0.93 | 0.90 | 0.14 | asserted 1.00 |
| s8 | Emotional support choices are thus path-dependent, progressively redirecting away from human connection. | interpretation 0.99 | 0.71 | 0.86 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
References
Discussion
Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.