Theoretical characterization of the inlier-memorization effect in simple autoencoders, deriving its emergence, strength, and persistence from data distribution and initialization, plus guidelines achieving SOTA on ADBench.
Deep Anomaly Detection Using Geometric Transformations
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We consider the problem of anomaly detection in images, and present a new detection technique. Given a sample of images, all known to belong to a "normal" class (e.g., dogs), we show how to train a deep neural model that can detect out-of-distribution images (i.e., non-dog objects). The main idea behind our scheme is to train a multi-class model to discriminate between dozens of geometric transformations applied on all the given images. The auxiliary expertise learned by the model generates feature detectors that effectively identify, at test time, anomalous images based on the softmax activation statistics of the model when applied on transformed images. We present extensive experiments using the proposed detector, which indicate that our algorithm improves state-of-the-art methods by a wide margin.
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
What Drives the Inlier-Memorization Effect? A Theory of Outlier Detection via Early Training Dynamics
Theoretical characterization of the inlier-memorization effect in simple autoencoders, deriving its emergence, strength, and persistence from data distribution and initialization, plus guidelines achieving SOTA on ADBench.