REVIEW 4 cited by
Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to \textit{explain} black box models, rather than creating models that are \textit{interpretable} in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward -- it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.
Forward citations
Cited by 4 Pith papers
-
Interpretable machine learning of halo gas density profiles: a sensitivity analysis of cosmological hydrodynamical simulations
Random forests reproduce simulated halo gas density profiles to roughly 80-90% accuracy, and Sobol analysis of those forests ranks halo mass and central gas mass as the dominant predictors across EAGLE, IllustrisTNG, ...
-
AlphaEval: A Comprehensive and Efficient Evaluation Framework for Formula Alpha Mining
AlphaEval scores alpha mining models on prediction, stability, robustness, logic, and diversity, replacing backtests with fast parallel metrics that the paper claims align with backtest outcomes.
-
Foundation Models for Astrophysics
Astronomical 'foundation models' largely reuse transformers and self-supervised pretraining, but evidence of transfer to new instruments, populations, or tasks remains rare; the paper argues such evidence, not archite...
-
The State of Post-Hoc Local XAI Techniques for Image Processing: Challenges and Motivations
A review of post-hoc local XAI techniques for images, covering motivations, challenges, and suggested future directions.
Discussion (0). Continue with ORCID to comment.