Pith. sign in

REVIEW 13 cited by

Examining Identity Drift in Conversations of LLM Agents

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.00804 v2 pith:2EGZCGZR submitted 2024-12-01 cs.CY cs.CL

classification cs.CYcs.CL
keywords identityconversationsdriftllmspersonaeffectfindingshelp
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large Language Models (LLMs) show impressive conversational abilities but sometimes show identity drift problems, where their interaction patterns or styles change over time. As the problem has not been thoroughly examined yet, this study examines identity consistency across nine LLMs. Specifically, we (1) investigate whether LLMs could maintain consistent patterns (or identity) and (2) analyze the effect of the model family, parameter sizes, and provided persona types. Our experiments involve multi-turn conversations on personal themes, analyzed in qualitative and quantitative ways. Experimental results indicate three findings. (1) Larger models experience greater identity drift. (2) Model differences exist, but their effect is not stronger than parameter sizes. (3) Assigning a persona may not help to maintain identity. We hope these three findings can help to improve persona stability in AI-driven dialogue systems, particularly in long-term conversations.

Discussion (0). Sign in to comment.

Forward citations

Cited by 13 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Two Confounds in Cross-Model Value Comparison: Response Determinism and the Access Harness

    cs.LG 2026-07 conditional novelty 7.0 of 10

    Cross-model value distances from single draws are inflated by response determinism and confounded by the deployment client; a repeated counterbalanced protocol plus flip/magnitude decomposition separates them.

  2. ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessions

    cs.CL 2026-05 unverdicted novelty 7.0 of 10

    ContextEcho benchmark shows persona drift occurs across 23 frontier models in long agentic-coding sessions, is not reliably reset by compaction, and can be restored by single-shot anchors with mode-dependent effects.

  3. A Scalable Approach to Evaluating Moral Sensitivity in LLMs

    cs.CY 2026-07 conditional novelty 6.5 of 10

    Under morally irrelevant noise, eight LLMs preserve the semantic content of identified moral features above calibrated floors, despite significant changes in feature counts.

  4. Deco: Extending Personal Physical Objects into Pervasive AI Companion through a Dual-Embodiment Framework

    cs.HC 2026-05 unverdicted novelty 6.0 of 10

    Deco introduces a dual-embodiment framework that extends emotional bonds from physical objects to AI companions via AR and LLMs, with user studies showing improved companionship, emotional connection, and well-being.

  5. Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes

    cs.CL 2026-01 conditional novelty 6.0 of 10

    A controlled study of 211 personas shows that moral disposition, not profile structure or familiarity, is the main bottleneck in role-playing agents, and a field-aware contrastive decoding method narrows the moral–imm...

  6. AI YOU Town: Make Friends and Money with Your Digital Twin

    cs.AI 2026-07 conditional novelty 5.0 of 10

    A unified LLM pipeline with Bayesian trait updates, conformal sets, and periodic memory-anchor refresh improves calibration and long-horizon persona fidelity over static prompting on module benchmarks.

  7. Multi-Turn Neural Transparency: Surfacing Neural Activations Improves User Calibration to LLM Behavioral Drift

    cs.HC 2026-05 unverdicted novelty 5.0 of 10

    Multi-turn neural transparency using behavioral vectors and dynamic visualizations improves user anticipation and evaluation of LLM trait expression while reducing overconfidence, per a randomized study with 246 participants.

  8. Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systems

    cs.MA 2026-05 unverdicted novelty 5.0 of 10

    Agentic AI needs social theory as a structural prior, formalized via the MASS dynamical system framework with four priors: strategic heterogeneity, networked-constrained dependence, co-evolution, and distributional in...

  9. Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systems

    cs.MA 2026-05 unverdicted novelty 4.0 of 10

    Agentic AI needs social theory as structural priors in the MASS framework to model emergent dynamics from multi-agent interactions.

  10. Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systems

    cs.MA 2026-05 unverdicted novelty 4.0 of 10

    Agentic AI requires social theory as a structural prior in the proposed MASS framework to model emergent outcomes from agent interactions and influence.

  11. Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges

    cs.AI 2025-10 unverdicted novelty 4.0 of 10

    A survey that taxonomizes threats to agentic AI, reviews benchmarks and evaluation methods, discusses technical and governance defenses, and identifies open challenges.

  12. LLM Harms: A Taxonomy and Discussion

    cs.CY 2025-12 reject novelty 3.0 of 10

    Proposes a five-bucket taxonomy of LLM harms and calls for dynamic auditing, but the systematic review behind it is not reproducible and contains mismatched citations.

  13. LLM Harms: A Taxonomy and Discussion

    cs.CY 2025-12 unverdicted novelty 3.0 of 10

    This paper proposes a taxonomy of LLM harms in five categories and suggests mitigation strategies plus a dynamic auditing system for responsible development.

Pith tools