REVIEW 12 cited by
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We propose a technique for producing "visual explanations" for decisions from a large class of CNN-based models, making them more transparent. Our approach - Gradient-weighted Class Activation Mapping (Grad-CAM), uses the gradients of any target concept, flowing into the final convolutional layer to produce a coarse localization map highlighting important regions in the image for predicting the concept. Grad-CAM is applicable to a wide variety of CNN model-families: (1) CNNs with fully-connected layers, (2) CNNs used for structured outputs, (3) CNNs used in tasks with multimodal inputs or reinforcement learning, without any architectural changes or re-training. We combine Grad-CAM with fine-grained visualizations to create a high-resolution class-discriminative visualization and apply it to off-the-shelf image classification, captioning, and visual question answering (VQA) models, including ResNet-based architectures. In the context of image classification models, our visualizations (a) lend insights into their failure modes, (b) are robust to adversarial images, (c) outperform previous methods on localization, (d) are more faithful to the underlying model and (e) help achieve generalization by identifying dataset bias. For captioning and VQA, we show that even non-attention based models can localize inputs. We devise a way to identify important neurons through Grad-CAM and combine it with neuron names to provide textual explanations for model decisions. Finally, we design and conduct human studies to measure if Grad-CAM helps users establish appropriate trust in predictions from models and show that Grad-CAM helps untrained users successfully discern a 'stronger' nodel from a 'weaker' one even when both make identical predictions. Our code is available at https://github.com/ramprs/grad-cam/, along with a demo at http://gradcam.cloudcv.org, and a video at youtu.be/COjUB9Izk6E.
Forward citations
Cited by 12 Pith papers
-
Towards Verified and Targeted Explanations through Formal Methods
ViTaX certifies targeted semifactual robustness: a minimal feature subset can be perturbed by ε without flipping a neural network from class y to a user-specified high-risk class t.
-
Simulation-based inference using splitting schemes for partially observed diffusions in chemical reaction networks
Chemical Langevin equations are rewritten as perturbed CIR-type SDEs, enabling a structure-preserving splitting scheme and an ABC-SMC algorithm for inference on partially observed reaction networks.
-
On Spectral Properties of Gradient-based Explanation Methods
Gradient-based explanations behave like frequency-band selectors: the gradient acts as a high-pass filter, perturbation as a low-pass filter, and their combination creates explanations that shift with the perturbation scale.
-
KIGNet: Physics-Motivated Multi-Graph Representation Learning for Explainable Jet Tagging
E-PCN reaches 94.67% macro-accuracy on 10-class jet tagging by weighting graphs with angular separation, transverse momentum, momentum fraction, and invariant mass, with Grad-CAM showing the first two account for 76% ...
-
Systematic Evaluation of Attribution Methods: Eliminating Threshold Bias and Revealing Method-Dependent Performance Patterns
Averaging IoU across many thresholds ranks XRAI above LIME and Integrated Gradients variants on HAM10000, and shows single-threshold attribution rankings are unstable.
-
PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification
View-specific multi-scale CBAM CNN ensembles plus hybrid ASL/focal loss and two-level gradient-boosting stacking reach ~0.93/0.92 macro AUROC on a CheXpert-style multi-label CXR dataset.
-
Structured Spectral Graph Representation Learning for Multi-label Abnormality Analysis from 3D CT Scans
A graph-of-slice-triplets encoder with spectral convolution outperforms 3D CNN/Transformer baselines on multi-label chest CT abnormality classification and transfers to report generation and abdominal CT.
-
Towards Optimal Convolutional Transfer Learning Architectures for Breast Lesion Classification and ACL Tear Detection
On two public medical imaging tasks, 1D convolutional classifiers with skip connections, ResNet50 backbones, and partial unfreezing gave the best validation AUC, while RadImageNet pretraining did not beat ImageNet.
-
On the Complexity-Faithfulness Trade-off of Gradient-Based Explanations
The paper introduces EF and ΔEF as spectral metrics, but ΔEF is derived from EF, making the complexity-faithfulness trade-off partly tautological.
-
Faithful, Interpretable Chest X-ray Diagnosis with Anti-Aliased B-cos Networks
Combining B-cos networks with anti-aliasing pooling (FLC or BlurPool) reduces grid artifacts in chest X-ray explanation maps while keeping diagnostic accuracy close to baseline networks.
-
CASE: Contrastive Activation for Saliency Estimation
CASE removes gradient components shared with confused classes to produce more class-distinct saliency maps, validated on a top-k overlap diagnostic where many existing methods show class-insensitive behavior.
-
XAI-Guided Analysis of Residual Networks for Interpretable Pneumonia Detection in Paediatric Chest X-rays
A fine-tuned ResNet-50 with Grad-CAM and Monte Carlo dropout reports 95.94% accuracy and 98.91% AUC for pediatric pneumonia on the Kermany chest X-ray dataset.
Discussion (0). Sign in to comment.