REVIEW 4 major objections 3 minor 1 cited by
The paper claims that AI explanations only enable human oversight if users actually pause to consider them, and an online study found that many participants did not.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
In an online study, participants frequently spent little time on AI explanations, so the assumption that human oversight catches AI errors by reading explanations is weak.
T0 review reviewed 2026-08-05 challenge →
load-bearing objection A transparent exploratory study that tests an important oversight assumption, but its 'little time = little consideration' proxy needs validation before the headline claim lands. the 4 major comments →
Can AI Explanations Make You Change Your Mind?
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
On the paper's own terms, the discovery is that the link between providing an explanation and achieving human oversight is broken by inattention: in the studied online setting, participants frequently did not spend enough time on the AI's explanation to meaningfully evaluate it. The reported analysis explores which factors, such as characteristics of the explanation or the decision context, drive how thoroughly participants engage, and whether deeper engagement corresponds to a greater openness to revising their initial judgment. The implied claim is that explanation quality alone is insufficient; the user's willingness or ability to attend to the explanation is the bottleneck.
What carries the argument
The central machinery is the study's measurement of 'consideration': behavioral indicators of how long and how carefully participants engaged with the explanation. This operationalization carries the argument, because the observed short engagement times are the evidence that the oversight assumption fails, and the subsequent correlational analysis uses that measure to separate engaged from disengaged users.
Load-bearing premise
The study assumes that the measured time spent (or similar behavioral trace) genuinely reflects how carefully participants considered the explanation, and that the behavior observed in a low-stakes online task represents how users would oversee AI in real-world settings.
What would settle it
A concrete check: run the same decision-support task but ask participants unexpected recall or comprehension questions about the explanation after each trial. If people who spent very little time still answer those questions as accurately as those who spent longer, the inference that short time equals shallow consideration collapses. Alternatively, if the pattern reverses for high-stakes scenarios with real consequences, the finding is an artifact of the study context.
If this is right
- If the finding holds, explanation-based oversight fails whenever users skim or ignore the explanation, so the accuracy of AI oversight depends on interface design and incentives as much as on explanation content.
- Systems cannot assume that a user who saw an explanation actually processed it; explanations may need to be gated, summarized, or tested to ensure consideration.
- Studies of explainable AI that measure only the presence of explanations likely overstate their effect, so engagement should be measured directly.
- Designers may need to adapt explanations to the limited time and attention users are willing to give them, for example by making key points visible at a glance.
Where Pith is reading between the lines
- The reported low engagement may partly stem from the low stakes of the online task; in high-stakes settings such as medical or financial decisions, users might read explanations far more carefully, making the deficiency context-dependent rather than universal.
- Short viewing time might not always mean low scrutiny; a user with a clear interface could quickly grasp the explanation, so recall or comprehension checks would be a stronger test than time alone.
- A testable extension: forcing users to spend a minimum time on the explanation or requiring them to summarize it before accepting the AI's suggestion should increase error-catching, if inattention is the true cause.
- Because the paper describes its analysis as exploratory, its factor associations are hypothesis-generating; a pre-registered replication with direct manipulation of stakes and obstacles would clarify which patterns are robust.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The abstract reports an online study on trust in explainable AI decision support systems. The authors expected that users would consider AI explanations in enough detail to catch AI errors, but they were 'surprised' to find that many participants spent little time on the explanation and did not always consider it in detail. The paper frames an exploratory analysis of which factors affect how carefully participants consider explanations and whether that consideration affects their willingness to change their mind based on the AI suggestion. The core claim is that the oversight benefit of explanations is frequently unrealized in practice because users do not engage with them.
Significance. If the empirical finding holds, the paper challenges a foundational assumption in XAI research and practice: that providing explanations leads to attentive human oversight. This is a valuable and potentially influential result, as it would imply that current explainability evaluation metrics and interface designs may overstate the practical value of explanations. The strength of the paper is its clear articulation of the assumption and a falsifiable behavioral prediction. However, because only the abstract is available for review, the methodological grounding—sample, measures, statistical analysis, and construct validation—is entirely absent. The significance of the finding cannot be assessed without these details. The exploratory framing also signals post-hoc analysis, which limits inferential strength unless corrected in the full paper.
major comments (4)
- [Abstract] The central claim that participants 'did not always consider [the explanation] in detail' appears to be operationalized by time spent on the explanation, but the abstract provides no evidence that time is a valid measure of cognitive engagement. Short viewing time could reflect user expertise, explanation simplicity, or interface layout rather than insufficient scrutiny, or it could indicate general disengagement from the study. Without validation against an independent indicator of comprehension or error detection (e.g., follow-up questions, accuracy on adversarial cases), the conclusion that users fail to oversee AI suggestions in detail is not supported. This is the load-bearing measurement-validity issue.
- [Abstract] No sample size, participant population, task description, or experimental design is reported. It is impossible to assess whether the finding is robust, how large an effect is claimed, or to whom the result generalizes. The abstract alone cannot support a journal-level empirical claim; a full methods section with these details is essential.
- [Abstract] The exploratory analysis is described only in qualitative terms ('what factors impact...'), with no reported factors, effect sizes, confidence intervals, or statistical tests. The phrase 'exploratory' in the abstract itself signals that the analysis is post-hoc, which raises the risk of overfitting to the observed data. The full paper must report whether these analyses were pre-specified or, if exploratory, provide appropriate corrections and interpretational caution.
- [Abstract] Generalization: the abstract implies a broad conclusion about human oversight of AI, but the study is a low-stakes online experiment. The boundary conditions are not discussed. For instance, participants facing real high-stakes AI oversight (e.g., medical or judicial decisions) may exhibit far more careful explanation engagement. The paper should either temper the generalization or provide evidence that the online setting is representative.
minor comments (3)
- [Abstract] The title is a question that the abstract does not directly answer. The abstract states the surprising disengagement finding but does not state whether participants were 'open to changing their mind' or whether the exploratory analysis found such an effect. Clarify the headline result.
- [Abstract] The abstract uses 'we were surprised'—this is colloquial for a formal report. Recommend a neutral phrasing such as 'contrary to expectations.'
- [Abstract] The term 'explainable DSS' is introduced without definition; spell out 'decision support system' at first use.
Circularity Check
No circularity: the abstract reports an empirical user study with no derivation chain, fitted parameters, or self-citation load-bearing claims.
full rationale
This paper is an empirical user study, not a mathematical derivation. The central claim—that participants often spent little time on explanations and did not always consider them in detail—is a report of observed behavior, not a result derived from a model whose assumptions already contain the conclusion. There are no equations, no fitted parameters being renamed as predictions, and no invocation of the authors' previous work to justify a load-bearing premise. The abstract's assumption that users will consider explanations in enough detail is an external premise about human oversight, not a definitional input that forces the empirical outcome. Even the potential concern that 'considering in detail' might be inferred from time spent is a construct-validity issue rather than circularity: the measure is not defined in terms of the conclusion, nor is the conclusion equivalent to the measure by construction. The study is self-contained with respect to circularity: it reports data and an exploratory analysis of that data. No circular step can be identified from the abstract alone, and nothing in the provided text reduces to its own inputs. Therefore the circularity score is 0.
Axiom & Free-Parameter Ledger
axioms (3)
- domain assumption Careful consideration of an explanation can be measured by behavioral proxies such as time spent on it.
- domain assumption Behavior in an online study generalizes to real-world human oversight of AI decision support.
- domain assumption Self-reported trust in the decision support system reflects users' actual willingness to rely on and override the AI.
Cite this review
Pith. "Pith review of Can AI Explanations Make You Change Your Mind?." pith.science (2026). https://pith.science/paper/TSSN32SM
@misc{pith2026250808158,
author = {Pith},
title = {Pith review of: Can AI Explanations Make You Change Your Mind?},
year = {2026},
howpublished = {\url{https://pith.science/paper/TSSN32SM}},
note = {Machine review of arXiv:2508.08158}
}
read the original abstract
In the context of AI-based decision support systems, explanations can help users to judge when to trust the AI's suggestion, and when to question it. In this way, human oversight can prevent AI errors and biased decision-making. However, this rests on the assumption that users will consider explanations in enough detail to be able to catch such errors. We conducted an online study on trust in explainable DSS, and were surprised to find that in many cases, participants spent little time on the explanation and did not always consider it in detail. We present an exploratory analysis of this data, investigating what factors impact how carefully study participants consider AI explanations, and how this in turn impacts whether they are open to changing their mind based on what the AI suggests.
Forward citations
Cited by 1 Pith paper
-
Interpretability Can Be Actionable
Interpretability research should be judged by actionability—the degree to which its insights support concrete decisions and interventions—rather than explanatory power alone.
This paper was first reviewed by deepseek-v4-flash on August 5, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.