ReplaySCM introduces a replay-based benchmark for executable causal mechanism induction that reveals sharp drops in LLM performance on held-out interventions when variable order or root structure is hidden, even after support audits eliminate inconsistent alternatives.
X3": 1} Rows: - u00: X1=0 X2=1 X3=1 X4=1 X5=0 - u01: X1=1 X2=0 X3=1 X4=0 X5=1 Output schema excerpt. {
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
ReplaySCM: A Benchmark for Executable Causal Mechanism Induction from Interventions
ReplaySCM introduces a replay-based benchmark for executable causal mechanism induction that reveals sharp drops in LLM performance on held-out interventions when variable order or root structure is hidden, even after support audits eliminate inconsistent alternatives.