A new 3,008-question assertion-reason benchmark shows language models often use semantic similarity as a substitute for causal explanation, with best models reaching only 0.55 MCC.
Dual-process theories of higher cognition: Advancing the debate
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
CLEAR-3K: Assessing Causal Explanatory Capabilities in Language Models
A new 3,008-question assertion-reason benchmark shows language models often use semantic similarity as a substitute for causal explanation, with best models reaching only 0.55 MCC.