Student-Teacher Feature Pyramid Matching for Anomaly Detection
read the original abstract
Anomaly detection is a challenging task and usually formulated as an one-class learning problem for the unexpectedness of anomalies. This paper proposes a simple yet powerful approach to this issue, which is implemented in the student-teacher framework for its advantages but substantially extends it in terms of both accuracy and efficiency. Given a strong model pre-trained on image classification as the teacher, we distill the knowledge into a single student network with the identical architecture to learn the distribution of anomaly-free images and this one-step transfer preserves the crucial clues as much as possible. Moreover, we integrate the multi-scale feature matching strategy into the framework, and this hierarchical feature matching enables the student network to receive a mixture of multi-level knowledge from the feature pyramid under better supervision, thus allowing to detect anomalies of various sizes. The difference between feature pyramids generated by the two networks serves as a scoring function indicating the probability of anomaly occurring. Due to such operations, our approach achieves accurate and fast pixel-level anomaly detection. Very competitive results are delivered on the MVTec anomaly detection dataset, superior to the state of the art ones.
This paper has not been read by Pith yet.
Forward citations
Cited by 6 Pith papers
-
HiMatch-AD: DINOv3-driven Hierarchical Matching for Training-free Medical Anomaly Detection
HiMatch-AD proposes DINOv3-driven hierarchical matching with uncertainty-based fusion for training-free medical anomaly detection and reports outperformance on the BMAD benchmark.
-
IAD-Unify: A Region-Grounded Unified Model for Industrial Anomaly Segmentation, Understanding, and Generation
IAD-Unify unifies industrial anomaly segmentation, region-grounded language understanding, and mask-guided generation in one framework using DINOv2 token injection into Qwen3.5, supported by the new Anomaly-56K datase...
-
Semantic Iterative Reconstruction: One-Shot Universal Anomaly Detection
A single model trained on one normal sample per dataset from nine heterogeneous medical sources achieves state-of-the-art anomaly detection in one-shot universal, full-shot universal, one-shot specialized, and full-sh...
-
Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detection
AAND is a two-stage anomaly detection method that advances a pre-trained teacher via residual anomaly amplification and applies hard knowledge distillation in reverse distillation to achieve SOTA results on MVTecAD, V...
-
MambaADv2: Evolving Duality-enhanced State Space Model for Unsupervised Anomaly Detection
MambaADv2 evolves Mamba state space models with hybrid blocks, frequency convolutions, and adaptive scanning for improved unsupervised anomaly detection.
-
AD4AD: Benchmarking Visual Anomaly Detection Models for Safer Autonomous Driving
Benchmarking shows VAD methods transfer to autonomous driving scenes, with Tiny-Dinomaly providing the strongest accuracy-efficiency balance for edge hardware.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.