A perturbation-based metric using FGSM flips of ±1/255 instead of zero-masking gives more consistent and monotonic evaluation of attribution maps across 15 CNN-dataset pairs, with SmoothGrad ranked first.
Zoom-CAM: Generating Fine-grained Pixel Annotations from Image Labels
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Current weakly supervised object localization and segmentation rely on class-discriminative visualization techniques to generate pseudo-labels for pixel-level training. Such visualization methods, including class activation mapping (CAM) and Grad-CAM, use only the deepest, lowest resolution convolutional layer, missing all information in intermediate layers. We propose Zoom-CAM: going beyond the last lowest resolution layer by integrating the importance maps over all activations in intermediate layers. Zoom-CAM captures fine-grained small-scale objects for various discriminative class instances, which are commonly missed by the baseline visualization methods. We focus on generating pixel-level pseudo-labels from class labels. The quality of our pseudo-labels evaluated on the ImageNet localization task exhibits more than 2.8% improvement on top-1 error. For weakly supervised semantic segmentation our generated pseudo-labels improve a state of the art model by 1.1%.
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Reliable Evaluation of Attribution Maps in CNNs: A Perturbation-Based Approach
A perturbation-based metric using FGSM flips of ±1/255 instead of zero-masking gives more consistent and monotonic evaluation of attribution maps across 15 CNN-dataset pairs, with SmoothGrad ranked first.