pith:3IE37OUW
Evaluating the False Trust Engendered by LLM Explanations
Reasoning traces and post-hoc explanations from LLMs increase user acceptance of answers whether correct or incorrect, while only dual explanations improve users' ability to tell the difference.
arxiv:2605.10930 v2 · 2026-05-11 · cs.HC
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{3IE37OUWYPQSMRHFCUPUEWNUNH}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
reasoning traces and post-hoc explanations are persuasive but not informative: they increase user acceptance of LLM predictions regardless of their correctness. In contrast, dual explanation is the only condition that genuinely improves users' ability to distinguish correct from incorrect AI outputs.
The assumption that the simulated setting where users do not have the means to verify the solution and the between-subject design with chosen tasks accurately measures real-world false trust and generalizes to critical task scenarios.
A user study finds that LLM reasoning traces and post-hoc explanations create false trust by increasing acceptance of incorrect answers, whereas contrastive dual explanations improve users' ability to detect errors.
Formal links
Receipt and verification
| First computed | 2026-05-20T00:02:13.021655Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
da09bfba96c3e12644e5151f4259b469f1c21782d961719cb7da537a89e82b24
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/3IE37OUWYPQSMRHFCUPUEWNUNH \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: da09bfba96c3e12644e5151f4259b469f1c21782d961719cb7da537a89e82b24
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "f327e1a5cd50f6f794e5f5a33856736c2448fde57f4076fd38948968298636e0",
"cross_cats_sorted": [],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.HC",
"submitted_at": "2026-05-11T17:58:12Z",
"title_canon_sha256": "c5626129d5149c04c92db68bbdb213b16d502872d5a74a69ce93174d5183fc4b"
},
"schema_version": "1.0",
"source": {
"id": "2605.10930",
"kind": "arxiv",
"version": 2
}
}