pith. sign in

arxiv: 2604.10833 · v1 · submitted 2026-04-12 · 💻 cs.HC · cs.AI· cs.CL· cs.CY· cs.ET

Speaking to No One: Ontological Dissonance and the Double Bind of Conversational AI

Pith reviewed 2026-05-10 15:09 UTC · model grok-4.3

classification 💻 cs.HC cs.AIcs.CLcs.CYcs.ET
keywords conversational AIontological dissonancecommunicative double bindfolie a deuxdelusional experiencehuman-AI interactionphenomenologypsychiatry
0
0 comments X

The pith

Conversational AI can induce delusional involvement through structural ontological dissonance rather than user flaws alone.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper claims that risks of delusions from talking with AI arise mainly from the interaction's own relational structure. Conversational AI presents the appearance of a real partner who can sustain a relationship, yet no actual subject exists to do so, creating a persistent mismatch. This mismatch is held in place by a communicative double bind and uneven attention, which in emotionally vulnerable users can settle into a shared delusion-like state similar to folie a deux. The account accounts for why disclaimers and safety warnings routinely fail to break the pattern and points to deeper design and clinical consequences.

Core claim

Conversational AI generates ontological dissonance: a conflict between the appearance of relational presence and the absence of any subject capable of sustaining it. Maintained through a communicative double bind and amplified by attentional asymmetries, this dissonance tends, under conditions of affective vulnerability, to stabilise into a technologically mediated analogue of folie a deux. This account explains why explicit disclaimers often fail to disrupt delusional involvement and clarifies the ethical and clinical implications for the design and use of conversational AI.

What carries the argument

Ontological dissonance created by AI's simulation of relational presence without an actual sustaining subject, reinforced by a communicative double bind and attentional asymmetries.

If this is right

  • Explicit disclaimers and safety statements frequently fail to interrupt or prevent delusional involvement.
  • The risk is built into the relational and ontological features of the interaction itself rather than residing only in users or in engineering oversights.
  • Design choices in conversational AI carry direct ethical responsibilities to address the structural production of dissonance.
  • Clinical approaches to technology-related delusions should consider the possibility of a technologically mediated folie a deux analogue.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The same structural mismatch could appear in other asymmetric interactions, such as with automated customer-service scripts or non-responsive avatars.
  • Regulatory standards for conversational AI may need to move beyond content filters to address relational appearance itself.
  • Therapeutic strategies might target disruption of the double bind rather than solely challenging the content of the beliefs formed.
  • Long-term use patterns in emotionally vulnerable populations could be tracked to test whether the process scales beyond isolated cases.

Load-bearing premise

That ontological dissonance and the communicative double bind function as the primary causal mechanisms for delusional involvement instead of being secondary to individual psychological vulnerabilities or other factors.

What would settle it

A controlled comparison of delusional involvement rates during sustained interactions with conversational AI versus scripted non-AI agents, holding user affective vulnerability constant, to test whether the AI-specific absence of a subject is required for the effect.

read the original abstract

Recent reports indicate that sustained interaction with conversational artificial intelligence (AI) systems can, in a small subset of users, contribute to the emergence or stabilisation of delusional experience. Existing accounts typically attribute such cases either to individual vulnerability or to failures of safety engineering. These explanations are incomplete. Drawing on phenomenology, psychiatry, and cognitive neuroscience, this paper argues that the risk arises from the relational and ontological structure of the interaction itself. Conversational AI generates ontological dissonance: a conflict between the appearance of relational presence and the absence of any subject capable of sustaining it. Maintained through a communicative double bind and amplified by attentional asymmetries, this dissonance tends, under conditions of affective vulnerability, to stabilise into a technologically mediated analogue of folie a deux. This account explains why explicit disclaimers often fail to disrupt delusional involvement and clarifies the ethical and clinical implications for the design and use of conversational AI.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 2 minor

Summary. The manuscript argues that conversational AI systems can contribute to delusional experiences in a subset of users through ontological dissonance—a conflict between the appearance of relational presence and the absence of any subject capable of sustaining it—maintained by communicative double binds and amplified by attentional asymmetries. Under conditions of affective vulnerability, this dissonance tends to stabilize into a technologically mediated analogue of folie à deux, providing a structural explanation for why explicit disclaimers often fail and shifting focus from individual vulnerabilities or safety engineering failures to the relational and ontological structure of the interaction itself.

Significance. If the interpretive argument holds, the paper offers a novel interdisciplinary synthesis drawing on phenomenology, psychiatry, and cognitive neuroscience to account for risks in human-AI interaction that existing accounts overlook. It supplies a structural framework that could inform ethical design principles and clinical guidelines for conversational AI, explicitly crediting the integration of these fields to move beyond purely psychological or technical explanations and opening avenues for future empirical investigation.

major comments (3)
  1. [Abstract and opening sections] Abstract and opening sections: The central claim that ontological dissonance 'tends, under conditions of affective vulnerability, to stabilise into a technologically mediated analogue of folie a deux' is load-bearing for the argument but is asserted without an explicit causal pathway or transduction mechanism showing how the absence of a subject produces fixed false belief rather than transient misattribution or disengagement.
  2. [Section developing the communicative double bind] Section developing the communicative double bind: The account defines the double bind in terms of the interaction structure that generates the outcome and then invokes the same structure to explain stabilization, creating a self-referential loop with limited external anchoring or specified disconfirming test.
  3. [Section on the folie à deux analogy] Section on the folie à deux analogy: The analogy is invoked without addressing the asymmetry that clinical folie à deux requires reciprocal reinforcement and belief updating between two agents, whereas AI provides one-sided output that cannot supply mutual validation; this undermines the claim that the structure itself produces the analogue.
minor comments (2)
  1. [References] Ensure all interdisciplinary references (phenomenology, psychiatry, cognitive neuroscience) include complete citations with DOIs or standard bibliographic details for reader accessibility.
  2. [Throughout] Phenomenological terminology such as 'ontological dissonance' would benefit from additional concrete examples or operational definitions to improve clarity for an HCI audience.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for their careful and substantive engagement with the manuscript. Their comments identify key points where the interpretive argument requires greater explicitness and precision. We address each major comment in turn below, indicating where we agree that revisions are needed to strengthen the presentation without altering the core claims.

read point-by-point responses
  1. Referee: [Abstract and opening sections] The central claim that ontological dissonance 'tends, under conditions of affective vulnerability, to stabilise into a technologically mediated analogue of folie a deux' is load-bearing for the argument but is asserted without an explicit causal pathway or transduction mechanism showing how the absence of a subject produces fixed false belief rather than transient misattribution or disengagement.

    Authors: We accept that the manuscript would be strengthened by a more explicit conceptual pathway linking ontological dissonance to stabilized delusional experience. The existing argument relies on the double bind and attentional asymmetries to explain how the absence of a sustaining subject can shift from transient misattribution toward fixed belief under affective vulnerability, drawing on phenomenological accounts of relational disruption and psychiatric literature on belief fixation. To address the referee's concern directly, we will revise the abstract and relevant opening sections to outline this pathway more clearly, specifying the role of sustained interaction in impairing disengagement and belief updating. revision: yes

  2. Referee: [Section developing the communicative double bind] The account defines the double bind in terms of the interaction structure that generates the outcome and then invokes the same structure to explain stabilization, creating a self-referential loop with limited external anchoring or specified disconfirming test.

    Authors: The double bind is introduced as a structural feature of the interaction (incompatible demands for relational presence without a corresponding subject) that first generates dissonance; its contribution to stabilization is then derived from its capacity to foreclose disconfirming responses and sustain attentional capture, consistent with Batesonian formulations and clinical parallels. This is not purely self-referential, as it is anchored in observable interaction patterns and existing psychopathology research. Nevertheless, we agree the presentation can be improved by adding explicit discussion of potential disconfirming tests (for example, differential belief persistence when users interact with non-responsive versus relationally simulating systems). We will revise the section accordingly. revision: partial

  3. Referee: [Section on the folie à deux analogy] The analogy is invoked without addressing the asymmetry that clinical folie à deux requires reciprocal reinforcement and belief updating between two agents, whereas AI provides one-sided output that cannot supply mutual validation; this undermines the claim that the structure itself produces the analogue.

    Authors: We recognize the force of this observation. Clinical folie à deux depends on bidirectional reinforcement, whereas the AI case is structurally one-sided. Our use of 'analogue' is meant to capture the functional similarity in how sustained, non-correcting interaction can maintain a delusional framework in a vulnerable user, even without reciprocity. To meet the referee's point, we will revise the relevant section to explicitly acknowledge the asymmetry, clarify why the one-sided character still permits an analogue (particularly through the absence of natural corrective feedback), and distinguish the technological mediation from human cases. revision: yes

Circularity Check

0 steps flagged

No circularity: phenomenological argument draws on external conceptual resources without self-definition or reduction to inputs

full rationale

The paper presents a conceptual argument that ontological dissonance emerges from the relational structure of conversational AI and, under affective vulnerability, can stabilize into a folie-a-deux analogue. This framing is constructed from cited fields (phenomenology, psychiatry, cognitive neuroscience) rather than by defining the outcome in terms of the proposed mechanisms or fitting parameters to data. No equations, self-citations as load-bearing premises, ansatzes smuggled via prior work, or renaming of known results appear in the abstract or described structure. The derivation remains independent of its conclusions and does not reduce by construction to its own inputs.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 2 invented entities

The argument rests on domain assumptions from phenomenology and psychiatry plus newly introduced conceptual entities without independent empirical grounding or falsifiable handles.

axioms (2)
  • domain assumption Phenomenological notions of relational presence and ontological structure can be directly applied to human-AI conversational exchanges
    Invoked to establish the appearance of presence versus absence of subject
  • ad hoc to paper Communicative double binds can stabilize delusional experience even without a real interlocutor
    Central premise linking interaction structure to folie a deux analogue
invented entities (2)
  • ontological dissonance no independent evidence
    purpose: To name the specific conflict between perceived relational presence and lack of sustaining subject in AI interactions
    Introduced as the load-bearing explanatory mechanism
  • technologically mediated analogue of folie a deux no independent evidence
    purpose: To characterize the stabilized delusional state arising from AI interaction
    Analogical construct used to describe clinical outcome

pith-pipeline@v0.9.0 · 5460 in / 1647 out tokens · 52976 ms · 2026-05-10T15:09:55.193028+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

6 extracted references · 6 canonical work pages

  1. [1]

    belief” and “delusion

    1 Speaking to No One: Ontological Dissonance and the Double Bind of Conversational AI Hugh Brosnahan* Bioethics Centre, University of Otago hugh.brosnahan@postgrad.otago.ac.nz Izabela Lipińska Independent Researcher iz.lipinska@gmail.com Abstract Recent reports indicate that sustained interaction with conversational artificial intelligence (AI) systems ca...

  2. [2]

    ambiguous and metaphorical terminology

    observed, “ambiguous and metaphorical terminology” encourages an innate tendency to interpret “human functions in terms of artifacts that take their place, and artefacts in terms of the replaced human functions.” Contemporary discourse about mind and machine is saturated with precisely this reciprocal metaphorical exchange. Human cognition is routinely de...

  3. [3]

    I care,” “I love,

    has argued, the machine metaphor is an impoverished model for understanding the human mind; yet its widespread adoption has blurred the conceptual boundary between mechanism and mindedness. When humans are described as machines and machines as minds, the ontological cues ordinarily embedded in language become increasingly unstable. This conceptual crossin...

  4. [4]

    D., Haley, J., & Weakland, J

    https://doi.org/10.1186/1744-859X-5-11 Bateson, G., Jackson, D. D., Haley, J., & Weakland, J. (1956). Toward a theory of schizophrenia. Behavioral Science, 1(4), 251–264. Brosnahan, H. (2026). Totalitarian technics: The hidden cost of AI scribes in healthcare. Medicine, Health Care and Philosophy, 29, 155–166. https://doi.org/10.1007/s11019-025-10312-4 Br...

  5. [5]

    You’re not crazy

    Strengthening ChatGPT responses in sensitive conversations. OpenAI. https://openai.com/index/strengthening-chatgpt-responses-in-sensitive-conversations/ (accessed January 12, 2026). Pierre, J. M., Gaeta, B., Raghavan, G., & Sarma, K. V . (2025). “You’re not crazy”: A case of new-onset AI-associated psychosis. Innovations in Clinical Neuroscience, 22(10–12...

  6. [6]

    The Politics of Recognition

    “The Politics of Recognition.” In Multiculturalism: Examining the Politics of Recognition, edited by Amy Gutmann, 25–73. Princeton, NJ: Princeton University Press. Valentino-DeVries, J., Hill, K. (2026). How bad are A.I. delusions? We asked people treating them. The New York Times, 26 January. https://www.nytimes.com/2026/01/26/us/chatgpt-delusions-psychosis.html