pith:ZTNOI2MA
The Model Says Walk: How Surface Heuristics Override Implicit Constraints in LLM Reasoning
Surface distance cues override implicit feasibility constraints in large language models, causing systematic reasoning failures.
arxiv:2603.29025 v3 · 2026-03-30 · cs.CL · cs.AI
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{ZTNOI2MA6LW5QXZ3TIFQ3UAGJT}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Causal-behavioral analysis of the car wash problem across six models reveals approximately context-independent sigmoid heuristics: the distance cue exerts 8.7 to 38 times more influence than the goal.
That minimal pairs and explicitness gradients in the HOB benchmark successfully isolate heuristic override from other factors such as knowledge gaps or prompt formatting effects.
LLMs prioritize surface heuristics such as distance cues over implicit constraints in reasoning tasks, with the new HOB benchmark showing no model exceeds 75% strict accuracy and hints recovering performance.
Receipt and verification
| First computed | 2026-06-10T01:11:00.301484Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
ccdae46980f2edd85f3b9a0b0dd0064cf33c03b7ca3b0baa4bf4f24a48b92c76
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/ZTNOI2MA6LW5QXZ3TIFQ3UAGJT \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: ccdae46980f2edd85f3b9a0b0dd0064cf33c03b7ca3b0baa4bf4f24a48b92c76
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "cea0c5463bbeb30c6ff2b5991a92f2f5a98170f80d935c0e485882b516924a57",
"cross_cats_sorted": [
"cs.AI"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CL",
"submitted_at": "2026-03-30T21:36:09Z",
"title_canon_sha256": "8a1d9c502100298aa25330f6715b65790937ccf05d273e7a888216b72f0ca37e"
},
"schema_version": "1.0",
"source": {
"id": "2603.29025",
"kind": "arxiv",
"version": 3
}
}