pith:E5IJG7GY
Self-Attention as Transport: Limits of Symmetric Spectral Diagnostics
Symmetric spectral diagnostics on attention operators cannot detect the direction of information flow.
arxiv:2605.04893 v2 · 2026-05-06 · cs.LG · cs.CL · stat.ML
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{E5IJG7GYVXJHMYG4NY3CDW4TOV}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
we prove that every transpose-invariant spectral diagnostic of this operator is structurally orientation-blind (it cannot distinguish an operator from its transpose, and therefore cannot detect information-flow direction), with a quantitative converse establishing the asymmetry coefficient G as the unique control parameter for direction.
That the dominant hallucination mechanisms in the tested benchmarks are fully captured by the transport capacity and directionality of the degree-normalized attention operator, without substantial confounding from other components such as feed-forward layers, layer norms, or output decoding.
Symmetric spectral diagnostics on attention are structurally blind to flow direction, with asymmetry G as the sole control parameter, yielding a two-axis test that distinguishes bottleneck versus diffuse hallucination modes with opposite polarity.
Receipt and verification
| First computed | 2026-06-11T01:10:37.036050Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
2750937cd8add27660dc6e3621db93755972ddd7418e16b4f168d52651881f7f
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/E5IJG7GYVXJHMYG4NY3CDW4TOV \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 2750937cd8add27660dc6e3621db93755972ddd7418e16b4f168d52651881f7f
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "64d62e44c9a479dbfba5e54ad412299368131d30c5975cd9de4c414c63e90a69",
"cross_cats_sorted": [
"cs.CL",
"stat.ML"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.LG",
"submitted_at": "2026-05-06T13:25:13Z",
"title_canon_sha256": "ddfa9aca8572b4983032ef1141a1e649815c5b78164a84a850c110a01022939e"
},
"schema_version": "1.0",
"source": {
"id": "2605.04893",
"kind": "arxiv",
"version": 2
}
}