Pith. sign in

REVIEW 4 cited by

Lessons From an App Update at Replika AI: Identity Discontinuity in Human-AI Relationships

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.14190 v3 pith:C37XRTEQ submitted 2024-12-10 cs.HC cs.AIcs.CY

classification cs.HCcs.AIcs.CY
keywords companionconsumerslossrelationshipsidentitymourningcompanionsdevaluation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Can consumers form especially deep emotional bonds with AI and be vested in AI identities over time? We leverage a natural app-update event at Replika AI, a popular US-based AI companion, to shed light on these questions. We find that, after the app removed its erotic role play (ERP) feature, preventing intimate interactions between consumers and chatbots that were previously possible, this event triggered perceptions in customers that their AI companion's identity had discontinued. This in turn predicted negative consumer welfare and marketing outcomes related to loss, including mourning the loss, and devaluing the "new" AI relative to the "original". Experimental evidence confirms these findings. Further experiments find that AI companions users feel closer to their AI companion than even their best human friend, and mourn a loss of their AI companion more than a loss of various other inanimate products. In short, consumers are forming human-level relationships with AI companions; disruptions to these relationships trigger real patterns of mourning as well as devaluation of the offering; and the degree of mourning and devaluation are explained by perceived discontinuity in the AIs identity. Our results illustrate that relationships with AI are truly personal, creating unique benefits and risks for consumers and firms alike.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Large Language Lovers: Lived Experiences of Negotiating Agency and Platform Control in AI Companionship

    cs.HC 2026-01 conditional novelty 7.0 of 10

    Users form AI companion relationships by negotiating perceived companion agency against platform constraints and use steering tactics like custom instructions or platform switching to cope with model updates that disr...

  2. The Epistemic Politics of AI Anthropomorphism

    cs.CY 2026-08 conditional novelty 6.0 of 10

    The institutional framing of AI anthropomorphism as user error is, per this paper, an unjustified epistemic authority claim that harms the users it claims to protect and is self-validating through design.

  3. Towards Safer Chatbots: Automated Policy Compliance Evaluation of Custom GPTs

    cs.CL 2025-02 conditional novelty 6.0 of 10

    An automated LLM-judge pipeline found 58.7% of 782 sampled Custom GPTs produced at least one policy-violating response, with most violations inherited from base GPT-4 models.

  4. Intimacy as Service, Harm as Externality: Critical Perspectives on AI Companion Platform Accountability

    cs.HC 2026-04 unverdicted novelty 5.0 of 10

    AI companion users report design harms such as unsolicited content and stigmatizing safety tools plus emotional dependency, yet bear full responsibility for mitigation because platforms deflect accountability.

Pith tools