Middle-removal truncation destroys the answer in most samples; when only distractors are removed, shorter context never hurts and sometimes improves small models.
BABILong: Testing the limits of LLMs with long context reasoning-in-a-haystack
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Distractor-Aware Truncation: Disentangling Context-Length Effects from Signal Loss in Long-Context LLM Benchmarks
Middle-removal truncation destroys the answer in most samples; when only distractors are removed, shorter context never hurts and sometimes improves small models.