Pith Number

pith:X6SQH5VV

pith:2026:X6SQH5VVKARAFFARJOYYKTMMB4

not attested not anchored not stored refs resolved

Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations

Haotian Li, Huamin Qu, Jianxun Lian, Nanxu Gong, Xing Xie, Yanjie Fu, Zishu Zhao, Zixin Chen

Theory of Mind gains on static benchmarks often fail to improve performance in live human-AI interactions.

arxiv:2605.15205 v1 · 2026-04-28 · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{X6SQH5VVKARAFFARJOYYKTMMB4}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

Improvements on static benchmarks do not always translate to better performance in dynamic HAI interactions.

C2weakest assumption

The chosen interactive tasks and user-study protocol sufficiently represent the first-person, dynamic, open-ended nature of typical human-AI interactions (section on paradigm shift and evaluation setup).

C3one line summary

Improvements in LLM Theory of Mind on static benchmarks do not reliably improve performance in dynamic, first-person human-AI interactions across goal-oriented and experience-oriented tasks.

References

63 extracted · 63 resolved · 1 Pith anchors

[1] Aho and Jeffrey D 1972

[2] Publications Manual , year = "1983", publisher = 1983

[3] Chandra and Dexter C 1981 · doi:10.1145/322234.322243

[4] Scalable training of

[5] Dan Gusfield , title =. 1997 1997

Receipt and verification

First computed	2026-05-20T00:00:45.990531Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

bfa503f6b550220294114bb1854d8c0f29b113f40174ed4eb8bde91362a39616

Aliases

arxiv: 2605.15205 · arxiv_version: 2605.15205v1 · doi: 10.48550/arxiv.2605.15205 · pith_short_12: X6SQH5VVKARA · pith_short_16: X6SQH5VVKARAFFAR · pith_short_8: X6SQH5VV

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/X6SQH5VVKARAFFARJOYYKTMMB4 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: bfa503f6b550220294114bb1854d8c0f29b113f40174ed4eb8bde91362a39616

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "c918c98312e1feb1ddd4db279bcc109852cd84ac7c9cdb84df646111ef1a46f8",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.AI",
    "submitted_at": "2026-04-28T15:38:31Z",
    "title_canon_sha256": "10c0bf16a93488d4d1f19e9b384f14b04a299a1605b3faead5126e5d91b199bf"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2605.15205",
    "kind": "arxiv",
    "version": 1
  }
}