Pith. sign in

REVIEW 5 major objections 5 minor 65 references

Noise Fusion-based Distillation Learning for Anomaly Detection in Complex Industrial Environments

T0 review · 5 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Pith's one-line read A heterogeneous teacher-student network with Gaussian noise training keeps industrial anomaly detection accurate when viewpoint, lighting, and resolution vary, and the paper reports gains of roughly 10 to 18 points on a multi-condition…

desk verdict A clean integration of known components with a strong headline result on a benchmark the authors co-authored; the external benchmarks are more modest, so the MSC-AD numbers need disclosure and reproducibility before the robustness claims hold. read the letter →

arxiv 2506.16050 v1 pith:UVGJGZKJ submitted 2025-06-19 cs.RO cs.CV

classification cs.ROcs.CV
keywords industrialanomalydetectionunsuperviseddefectknowledgedistillationheterogeneousteachernetworkmultivariateGaussiannoisefeaturefusionMSC-ADdatasetreal-timeinspection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that anomaly detection on manufactured parts can stay accurate when the camera view, pose, lighting, and resolution change, which is exactly what happens when a robot arm moves a camera over a workpiece. The proposed method, HetNet, pairs a CNN teacher with a Transformer teacher so local details and long-range context are both represented, fuses those features adaptively, and adds a noise generator that samples from per-position Gaussian models of normal training features. The student network learns both to reconstruct normal features and to denoise corrupted ones. On the MSC-AD benchmark the paper reports 85.81 image-level AUROC, 97.97 pixel-level AUROC, and 94.71 pixel-level AUPRO, improving image-level AUROC by 18.46 points over the second-best method and roughly 10 points on pixel-level metrics, with similar results on MVTec-AD, VisA, and MPDD. If the claim holds, production-line inspection can tolerate unstructured imaging conditions without losing accuracy.

What carries the argument

The load-bearing mechanism is the Local Multivariate Gaussian Noise (LMGN) generator combined with the collaborative student decoder. For each spatial location in the CNN teacher feature maps, the generator computes the mean and covariance of feature vectors across all normal training images, then samples noise from that multivariate Gaussian and adds it into the teacher features at local positions. Those corrupted features pass through the same adaptive fusion and student decoder as the clean features, so the student is trained jointly to reconstruct the normal prototype and to remove benign variation. The heterogeneous teacher pair, a WideResNet50 CNN for local texture and a Swin Transformer for long-range context, supplies the complementary representations that the Adaptive Local-Global Feature fusion module combines through cross-structure attention. The work of this machinery is to widen the student's acceptance region so that specular reflections, blur, and scale changes are reconstructed normally while true defects still produce large teacher-student discrepancies.

What would settle it

Take a deployment condition excluded from training, such as illumination below the darkest training level or a viewpoint not covered by the training images, and measure image-level AUROC on MSC-AD. If it drops to the level of the baselines, the Gaussian envelope of the training distribution, rather than general environmental robustness, carried the result.

Watch

Extended reading notes

Core claim

HetNet claims that a reverse-distillation student can learn a normal-feature manifold that includes environmental perturbations if it is trained with two complementary teachers and a denoising task. A CNN teacher and a Transformer teacher produce local and global features; an adaptive local-global fusion module combines them at each layer, and a multi-scale fusion module assembles prototype and noisy features. The Local Multivariate Gaussian Noise generator estimates a mean and covariance at every spatial position of the CNN features over the normal training set, samples noise from that distribution, and feeds the corrupted features into a shared student decoder that optimizes both reconstruction and denoising losses. At inference the noise generator is removed, and the difference between teacher and student features yields the anomaly map. The paper's central reported result is that on MSC-AD this raises image-level AUROC to 85.81 with pixel AUROC 97.97 and AUPRO 94.71, and that the same design reaches state-of-the-art numbers on MVTec-AD, VisA, and MPDD.

Load-bearing premise

The whole robustness story depends on the per-position multivariate Gaussian distributions estimated from the normal training set being an accurate envelope of all benign appearance variations; if a deployment view, light level, or resolution falls outside that envelope, the denoising training will not transfer and performance will degrade.

Editorial extensions

If this is right

  • A single model trained on normal images can replace detectors that flag benign reflections, blur, and scale changes as defects, reducing false alarms in robot-based inspection lines.
  • The same architecture transfers across benchmarks with different lighting and background conditions, suggesting the robustness is not specific to casting surfaces.
  • With per-image inference of 0.27 to 0.33 seconds, the method fits the speed budget of automated production lines on modest hardware.
  • The high pixel-level AUPRO implies small defects remain localizable even where image-level detection is hardest, addressing a known weakness of AUROC-style evaluation.
  • The noise generator is discarded at inference, so the deployed system adds no extra computation beyond the teacher-student difference map.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct extension would replace the unconditional per-position Gaussians with Gaussians conditioned on estimated pose or illumination, which would test whether modeling the environmental variable explicitly adds robustness beyond the current implicit modeling.
  • The method's reliance on ImageNet-pretrained teachers means the Gaussian statistics are tied to that feature space; applying the same LMGN idea to self-supervised or task-specific backbones could show whether the noise-envelope mechanism transfers across representations.
  • The reported inference speed suggests using HetNet as a first-pass screening stage would be practical; a natural deployment study would count missed small defects when the anomaly map is thresholded to trigger a slower high-resolution inspection step.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper proposes HetNet, an unsupervised anomaly detection and localization framework for industrial inspection under varying resolution, illumination, and view. The method combines a frozen CNN teacher (WideResNet-50) and a frozen Swin-Transformer teacher, fuses their features via an adaptive local-global attention module and a multi-scale fusion module, and trains a shared student decoder with reconstruction and denoising losses. A Local Multivariate Gaussian Noise (LMGN) generator, based on per-position feature statistics following PaDiM, corrupts features during training and is discarded at inference. The authors report large gains on the MSC-AD dataset and state-of-the-art results on MVTec-AD, VisA, and MPDD, plus a qualitative real-world deployment.

Significance. If the reported results are reproducible, the architectural combination is a sensible incremental contribution that could improve robustness to environmental variation in unsupervised industrial anomaly detection. The design is not conceptually novel—each component is drawn from existing methods such as reverse distillation, cross-attention fusion, and PaDiM-style Gaussian modeling—but the integration is new and the reported MSC-AD margin, if real, would be practically important. The paper is clearly written at a high level, and the approach of denoising on feature statistics is grounded in a known successful method. However, the primary evidence is compromised by the fact that the main benchmark was created by an overlapping group, no code or variance estimates are provided, and the abstract's quantitative claim is inconsistent with the table. The paper therefore needs substantial revision before the central claims can be considered established.

major comments (5)
  1. [Section IV-A, Table I; reference [15]] The MSC-AD dataset used for the headline evaluation was introduced in reference [15], which shares co-authors with this submission (J. Yu, B. Wang, Y. Song, W. Zhang). The paper does not disclose this overlap, and Table I's large margins (e.g., +18.46 points I-AUROC over CFA) are reported without error bars, seeds, or a description of how the baseline numbers were produced. Because the central claim rests on this benchmark, the authors should clearly disclose the conflict, release the evaluation code and trained checkpoints, and report the exact protocol for baselines and variance across multiple runs.
  2. [Abstract; Table I] The abstract claims 'approximately 10% improvement across all evaluation metrics on MSC-AD.' Using the Total Average row of Table I, the improvement over the second-best method is 18.46 percentage points in Image-AUROC, 8.62 in Pixel-AUROC, and 7.24 in Pixel-AUPRO. These are not all 'approximately 10%,' and the statement should be either corrected to precise numbers or reframed to avoid overstating the gain.
  3. [Section IV.C] The real-world deployment section reports only the hardware setup and inference speed (0.27–0.33 s per image). No detection accuracy, no ground-truth labels, no comparison with the proposed method's own benchmark performance, and no baseline methods are reported. The claim that HetNet 'can be effectively integrated into production lines to achieve robust and real-time anomaly detection' is therefore not supported by quantitative evidence and should be either substantiated with proper evaluation or removed.
  4. [Section III.D, Fig. 2] The LMGN noise generation procedure is ambiguous. The text states that noise is sampled from N(mu_ij, Sigma_ij) and 'add it into features extracted from the teacher network,' whereas Fig. 2 shows the operations as 'Sample&Replace' and 'Replace with Noise,' and the caption describes 'Introduce noise before the features are passed to the ALGF module.' The phrase 'noise of random size' is also undefined. Since LMGN is one of the three main contributions, the paper must specify precisely whether features are replaced or perturbed additively, and what 'size' controls.
  5. [Section III.D, Section IV.A.3] The paper's claim of resilience to environmental fluctuations is only supported by evaluations on datasets whose conditions are presumably represented in the training set. The MSC-AD protocol is not described in terms of train/test split per condition, so it is unclear whether robustness is tested under distribution shift at all. To support the central claim, the authors should specify the split and add an experiment where the test condition (e.g., a new illumination level or camera) is not seen during training.
minor comments (5)
  1. [Table I] The CFLOW entry for 'front' surface reports pixel-AUROC as '9..87'; this is presumably a typo for 90.87 or 91.87. Also, several entries are marked 'N' (not available), making the table incomplete; indicate the reason for missing values.
  2. [Table IV] The abbreviations I-AU, P-AU, P-PRO are not defined in the caption; they should be expanded (Image-AUROC, Pixel-AUROC, Pixel-AUPRO).
  3. [Table III] The label 'mGds' is not defined; use a descriptive name such as 'Multivariate Gaussian (Ours)' to match the notation in Section III.D.
  4. [Reproducibility statement] The project website URL is mentioned in the abstract, but the paper does not include a link to a code repository with a version identifier; please add a stable reproducibility link and a statement about the exact environment (PyTorch version, GPU, random seeds).
  5. [Section II.A] The term 'reverse distillation' is used without defining it; readers unfamiliar with [30] may not understand the student-teacher relationship. Consider a brief definition early in Section II.A or III.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: HetNet's denoising-distillation training is an empirical scheme, and its central improvements are not forced by construction; the MSC-AD authorship overlap is an independence/reproducibility concern, not a circular step.

full rationale

The paper makes no first-principles derivation that could reduce to its inputs. The LMGN generator estimates per-position multivariate Gaussian statistics from normal training features (following PaDiM [19]) and uses random samples from that distribution as a data-augmentation/denoising target for the student network; this is a standard self-supervised training technique, not a fitted parameter renamed as a prediction. At inference the LMGN is discarded and anomaly maps come from teacher-student cosine-similarity discrepancies (Eq. 3), so the reported anomaly scores are not equal by construction to the fitted Gaussian parameters. The method is also evaluated on external benchmarks MVTec-AD, VisA, and MPDD, where no overlap with the authors' prior dataset is present. The main caveat is that the headline MSC-AD results use a dataset [15] with overlapping authors (J. Yu, B. Wang, W. Zhang) and the paper does not disclose this overlap, provide code, or report error bars; this is a legitimate reproducibility and benchmark-independence concern, but it does not make the method's derivation circular. No quoted equation or fitted quantity reduces to another, so no circular step meeting the evidence bar is present.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

The method's empirical gains rest on a set of unstated transfer and modeling assumptions, plus hand-chosen hyperparameters and an in-house benchmark. No new physical entities are introduced.

free parameters (4)
  • alpha (L_Recon weight) = 0.1
    Weights the reconstruction loss relative to the distillation loss in Eq. (4); set by hand, no sensitivity analysis.
  • mu_ij and Sigma_ij per-position Gaussian parameters = estimated from training-set features
    The LMGN noise distribution is fit to normal training features at each feature-map position, following PaDiM [19]; these values determine the noise that drives the denoising task.
  • k (feature layers used) = {1,2,3}
    Intermediate Swin-T and WRN-50 layers chosen for distillation; no ablation on layer selection.
  • random noise box size/interpolation = not fully specified
    The paper says 'sample a noise of random size xi' and 'noise boxes Interpolate & Size Adjust' (Fig. 2) but the size and interpolation procedure are not precisely defined.
assumptions (4)
  • domain assumption Frozen ImageNet-pretrained WideResNet-50 and Swin-T features transfer to casting-surface anomaly detection.
    The method relies entirely on pretrained features without fine-tuning; this transferability is assumed (Section III.B).
  • domain assumption Cosine similarity between teacher and student features is a reliable anomaly score.
    Reverse distillation scoring is taken from [27], [30]; the paper does not validate this score on variable-condition data independently.
  • domain assumption Position-wise multivariate Gaussian modeling of normal features is valid for complex environments.
    Adopted from PaDiM [19]; the paper provides no goodness-of-fit check for the Gaussian assumption on MSC-AD.
  • domain assumption The MSC-AD benchmark protocol faithfully represents real industrial inspection conditions.
    MSC-AD was created by co-authors of this paper; its realism is asserted via citation [15] rather than independent evaluation.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Noise Fusion-based Distillation Learning for Anomaly Detection in Complex Industrial Environments." pith.science (2026). https://pith.science/paper/UVGJGZKJ

@misc{pith2026250616050,
  author       = {Pith},
  title        = {Pith review of: Noise Fusion-based Distillation Learning for Anomaly Detection in Complex Industrial Environments},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/UVGJGZKJ}},
  note         = {Machine review of arXiv:2506.16050}
}
read the original abstract

Anomaly detection and localization in automated industrial manufacturing can significantly enhance production efficiency and product quality. Existing methods are capable of detecting surface defects in pre-defined or controlled imaging environments. However, accurately detecting workpiece defects in complex and unstructured industrial environments with varying views, poses and illumination remains challenging. We propose a novel anomaly detection and localization method specifically designed to handle inputs with perturbative patterns. Our approach introduces a new framework based on a collaborative distillation heterogeneous teacher network (HetNet), an adaptive local-global feature fusion module, and a local multivariate Gaussian noise generation module. HetNet can learn to model the complex feature distribution of normal patterns using limited information about local disruptive changes. We conducted extensive experiments on mainstream benchmarks. HetNet demonstrates superior performance with approximately 10% improvement across all evaluation metrics on MSC-AD under industrial conditions, while achieving state-of-the-art results on other datasets, validating its resilience to environmental fluctuations and its capability to enhance the reliability of industrial anomaly detection systems across diverse scenarios. Tests in real-world environments further confirm that HetNet can be effectively integrated into production lines to achieve robust and real-time anomaly detection. Codes, images and videos are published on the project website at: https://zihuatanejoyu.github.io/HetNet/

Figures

Figures reproduced from arXiv: 2506.16050 by the authors.

Figure 1
Figure 1. (a) Illustration of our task setup. The moving robot arm introduces variations in imaging conditions like resolution, [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. The overall framework of HetNet. The heterogeneous teacher encoders initially extract pre-trained features, after [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Qualitative results on the MSC-AD dataset [15], demonstrating the efficacy of HetNet. From left to right, we present [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (2 more)
Figure 5
Figure 5. Figure 5: The real-world environment setting. performance across three diverse public benchmarks. On the MVTec AD dataset, our approach attains the highest image￾level AUC score of 99.19% and pixel-level PRO score of 94.63%, which can be attributed to the heterogeneous feature e…
Figure 4
Figure 4. Figure 4: Qualitative comparisons demonstrating HetNet’s ef [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

65 extracted references · 44 canonical work pages

  1. [15]

    Msc-ad: A multiscene unsupervised anomaly detection dataset for small defect detection of casting surface,

    Q. Zhao, Y . Wang, B. Wang, J. Lin, S. Yan, W. Song, A. Liotta, J. Yu, S. Gao, and W. Zhang, “Msc-ad: A multiscene unsupervised anomaly detection dataset for small defect detection of casting surface,”IEEE Transactions on Industrial Informatics, 2023

  2. [1]

    Context-aware adaptive weighted attention network for real-time surface defect segmentation,

    G. Zhang, Y . Lu, X. Jiang, F. Yan, and M. Xu, “Context-aware adaptive weighted attention network for real-time surface defect segmentation,” IEEE Transactions on Instrumentation and Measurement, vol. 73, pp. 1–13, 2024

  3. [2]

    Fabric defect detection using computer vision techniques: a comprehensive review,

    A. Rasheed, B. Zafar, A. Rasheed, N. Ali, M. Sajid, S. H. Dar, U. Habib, T. Shehryar, and M. T. Mahmood, “Fabric defect detection using computer vision techniques: a comprehensive review,”Mathe- matical Problems in Engineering, vol. 2020, no. 1, p. 8189403, 2020

  4. [3]

    Internal defect detection of overhead aluminum conductor composite core transmission lines with an inspection robot and computer vision,

    F. Wang, G. Song, J. Mao, Y . Li, Z. Ji, D. Chen, and A. Song, “Internal defect detection of overhead aluminum conductor composite core transmission lines with an inspection robot and computer vision,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1–16, 2023

  5. [4]

    Aff-net: A strip steel surface defect detection network via adaptive focusing features,

    Y . Du, H. Chen, Y . Fu, J. Zhu, and H. Zeng, “Aff-net: A strip steel surface defect detection network via adaptive focusing features,”IEEE Transactions on Instrumentation and Measurement, vol. 73, pp. 1–14, 2024

  6. [5]

    Surface defect detection methods for industrial products: A review,

    Y . Chen, Y . Ding, F. Zhao, E. Zhang, Z. Wu, and L. Shao, “Surface defect detection methods for industrial products: A review,”Applied Sciences, vol. 11, no. 16, p. 7657, 2021

  7. [6]

    Mvtec ad– a comprehensive real-world dataset for unsupervised anomaly detec- tion,

    P. Bergmann, M. Fauser, D. Sattlegger, and C. Steger, “Mvtec ad– a comprehensive real-world dataset for unsupervised anomaly detec- tion,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 9592–9600

  8. [7]

    Improving unsupervised defect segmentation by applying structural similarity to autoencoders,

    P. Bergmann, S. Löwe, M. Fauser, D. Sattlegger, and C. Steger, “Improving unsupervised defect segmentation by applying structural similarity to autoencoders,”arXiv preprint arXiv:1807.02011, 2018

Show all 65 references
  1. [8]

    Deep anomaly detection using geometric transformations,

    I. Golan and R. El-Yaniv, “Deep anomaly detection using geometric transformations,”Advances in neural information processing systems, vol. 31, 2018

  2. [9]

    Memorizing normality to detect anomaly: Memory- augmented deep autoencoder for unsupervised anomaly detection,

    D. Gong, L. Liu, V . Le, B. Saha, M. R. Mansour, S. Venkatesh, and A. v. d. Hengel, “Memorizing normality to detect anomaly: Memory- augmented deep autoencoder for unsupervised anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognit...

  3. [10]

    Learning memory-guided normality for anomaly detection,

    H. Park, J. Noh, and B. Ham, “Learning memory-guided normality for anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 14 372–14 381

  4. [11]

    Multiresolution knowledge distillation for anomaly detection,

    M. Salehi, N. Sadjadi, S. Baselizadeh, M. H. Rohban, and H. R. Ra- biee, “Multiresolution knowledge distillation for anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 14 902–14 912

  5. [13]

    Unsupervised image anomaly detection and segmentation based on pretrained feature mapping,

    Q. Wan, L. Gao, X. Li, and L. Wen, “Unsupervised image anomaly detection and segmentation based on pretrained feature mapping,” IEEE Transactions on Industrial Informatics, vol. 19, no. 3, pp. 2330– 2339, 2022

  6. [14]

    Real-iad: A real-world multi-view dataset for benchmarking versatile industrial anomaly detection,

    C. Wang, W. Zhu, B.-B. Gao, Z. Gan, J. Zhang, Z. Gu, S. Qian, M. Chen, and L. Ma, “Real-iad: A real-world multi-view dataset for benchmarking versatile industrial anomaly detection,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog- nition, 2024, p...

  7. [16]

    Imagenet classifica- tion with deep convolutional neural networks,

    A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classifica- tion with deep convolutional neural networks,”Advances in neural information processing systems, vol. 25, 2012

  8. [17]

    Sub-image anomaly detection with deep pyramid correspondences,

    N. Cohen and Y . Hoshen, “Sub-image anomaly detection with deep pyramid correspondences,”arXiv preprint arXiv:2005.02357, 2020

  9. [18]

    Towards total recall in industrial anomaly detection,

    K. Roth, L. Pemula, J. Zepeda, B. Schölkopf, T. Brox, and P. Gehler, “Towards total recall in industrial anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recogni- tion, 2022, pp. 14 318–14 328

  10. [19]

    Padim: a patch distribution modeling framework for anomaly detection and localiza- tion,

    T. Defard, A. Setkov, A. Loesch, and R. Audigier, “Padim: a patch distribution modeling framework for anomaly detection and localiza- tion,” inInternational Conference on Pattern Recognition. Springer, 2021, pp. 475–489

  11. [20]

    Pni: Industrial anomaly detection using position and neighborhood information,

    J. Bae, J.-H. Lee, and S. Kim, “Pni: Industrial anomaly detection using position and neighborhood information,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 6373–6383

  12. [21]

    Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional nor- malizing flows,

    D. Gudovskiy, S. Ishizaka, and K. Kozuka, “Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional nor- malizing flows,” inProceedings of the IEEE/CVF winter conference on applications of computer vision, 2022, pp. 98–107

  13. [22]

    Sanflow: Semantic-aware normal- izing flow for anomaly detection,

    D. Kim, S. Baik, and T. H. Kim, “Sanflow: Semantic-aware normal- izing flow for anomaly detection,”Advances in Neural Information Processing Systems, vol. 36, pp. 75 434–75 454, 2023

  14. [23]

    Cutpaste: Self-supervised learning for anomaly detection and localization,

    C.-L. Li, K. Sohn, J. Yoon, and T. Pfister, “Cutpaste: Self-supervised learning for anomaly detection and localization,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 9664–9674

  15. [24]

    Natural synthetic anomalies for self-supervised anomaly detection and localization,

    H. M. Schlüter, J. Tan, B. Hou, and B. Kainz, “Natural synthetic anomalies for self-supervised anomaly detection and localization,” in European Conference on Computer Vision. Springer, 2022, pp. 474– 489

  16. [25]

    Simplenet: A simple network for image anomaly detection and localization,

    Z. Liu, Y . Zhou, Y . Xu, and Z. Wang, “Simplenet: A simple network for image anomaly detection and localization,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 20 402–20 411

  17. [26]

    Cfa: Coupled-hypersphere-based feature adaptation for target-oriented anomaly localization,

    S. Lee, S. Lee, and B. C. Song, “Cfa: Coupled-hypersphere-based feature adaptation for target-oriented anomaly localization,”IEEE Access, vol. 10, pp. 78 446–78 454, 2022

  18. [27]

    Distilling the knowledge in a neural network,

    G. Hinton, “Distilling the knowledge in a neural network,”arXiv preprint arXiv:1503.02531, 2015

  19. [28]

    Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings,

    P. Bergmann, M. Fauser, D. Sattlegger, and C. Steger, “Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings,” inProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), June 2020

  20. [29]

    Student-teacher feature pyramid matching for anomaly detection,

    G. Wang, S. Han, E. Ding, and D. Huang, “Student-teacher feature pyramid matching for anomaly detection,”arXiv preprint arXiv:2103.04257, 2021

  21. [30]

    Anomaly detection via reverse distillation from one-class embedding,

    H. Deng and X. Li, “Anomaly detection via reverse distillation from one-class embedding,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 9737–9746

  22. [31]

    Remembering normality: Memory- guided knowledge distillation for unsupervised anomaly detection,

    Z. Gu, L. Liu, X. Chen, R. Yi, J. Zhang, Y . Wang, C. Wang, A. Shu, G. Jiang, and L. Ma, “Remembering normality: Memory- guided knowledge distillation for unsupervised anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023...

  23. [32]

    Destseg: Seg- mentation guided denoising student-teacher for anomaly detection,

    X. Zhang, S. Li, X. Li, P. Huang, J. Shan, and T. Chen, “Destseg: Seg- mentation guided denoising student-teacher for anomaly detection,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 3914–3923

  24. [33]

    Removing anomalies as noises for industrial defect localization,

    F. Lu, X. Yao, C.-W. Fu, and J. Jia, “Removing anomalies as noises for industrial defect localization,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 16 166–16 175

  25. [34]

    Unsupervised surface anomaly detection with diffusion probabilistic model,

    X. Zhang, N. Li, J. Li, T. Dai, Y . Jiang, and S.-T. Xia, “Unsupervised surface anomaly detection with diffusion probabilistic model,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 6782–6791

  26. [35]

    Draem-a discriminatively trained reconstruction embedding for surface anomaly detection,

    V . Zavrtanik, M. Kristan, and D. Sko ˇcaj, “Draem-a discriminatively trained reconstruction embedding for surface anomaly detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 8330–8339

  27. [36]

    Adtr: Anomaly detection transformer with feature reconstruction,

    Z. You, K. Yang, W. Luo, L. Cui, Y . Zheng, and X. Le, “Adtr: Anomaly detection transformer with feature reconstruction,” inInternational Conference on Neural Information Processing. Springer, 2022, pp. 298–310

  28. [37]

    A unified model for multi-class anomaly detection,

    Z. You, L. Cui, Y . Shen, K. Yang, X. Lu, Y . Zheng, and X. Le, “A unified model for multi-class anomaly detection,”Advances in Neural Information Processing Systems, vol. 35, pp. 4571–4584, 2022

  29. [38]

    Template-guided hierarchical feature restoration for anomaly detection,

    H. Guo, L. Ren, J. Fu, Y . Wang, Z. Zhang, C. Lan, H. Wang, and X. Hou, “Template-guided hierarchical feature restoration for anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 6447–6458

  30. [39]

    Focus the discrepancy: Intra-and inter-correlation learning for image anomaly detection,

    X. Yao, R. Li, Z. Qian, Y . Luo, and C. Zhang, “Focus the discrepancy: Intra-and inter-correlation learning for image anomaly detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 6803–6813

  31. [40]

    Omnial: A unified cnn framework for unsupervised anomaly localization,

    Y . Zhao, “Omnial: A unified cnn framework for unsupervised anomaly localization,” inProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, 2023, pp. 3924–3933

  32. [41]

    Generative adversarial net- works,

    I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y . Bengio, “Generative adversarial net- works,”Communications of the ACM, vol. 63, no. 11, pp. 139–144, 2020

  33. [42]

    Attention is all you need,

    A. Vaswani, “Attention is all you need,”Advances in Neural Informa- tion Processing Systems, 2017

  34. [43]

    Denoising diffusion probabilistic models,

    J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,”Advances in neural information processing systems, vol. 33, pp. 6840–6851, 2020

  35. [44]

    Revisiting reverse distillation for anomaly detection,

    T. D. Tien, A. T. Nguyen, N. H. Tran, T. D. Huy, S. Duong, C. D. T. Nguyen, and S. Q. Truong, “Revisiting reverse distillation for anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 24 511–24 520

  36. [45]

    Recontrast: Domain-specific anomaly detection via contrastive reconstruction,

    J. Guo, L. Jia, W. Zhang, H. Li,et al., “Recontrast: Domain-specific anomaly detection via contrastive reconstruction,”Advances in Neural Information Processing Systems, vol. 36, 2024

  37. [46]

    Learning feature inversion for multi-class anomaly detection under general-purpose coco-ad benchmark,

    J. Zhang, C. Wang, X. Li, G. Tian, Z. Xue, Y . Liu, G. Pang, and D. Tao, “Learning feature inversion for multi-class anomaly detection under general-purpose coco-ad benchmark,”arXiv preprint arXiv:2404.10760, 2024

  38. [47]

    Weakly supervised learning for industrial optical inspection,

    M. Wieler and T. Hahn, “Weakly supervised learning for industrial optical inspection,” inDAGM symposium in, vol. 6, 2007, p. 11

  39. [48]

    Detection of power line insulator defects using aerial images analyzed with convolutional neural networks,

    X. Tao, D. Zhang, Z. Wang, X. Liu, H. Zhang, and D. Xu, “Detection of power line insulator defects using aerial images analyzed with convolutional neural networks,”IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2018

  40. [49]

    Miad: A maintenance inspection dataset for unsupervised anomaly detection,

    T. Bao, J. Chen, W. Li, X. Wang, J. Fei, L. Wu, R. Zhao, and Y . Zheng, “Miad: A maintenance inspection dataset for unsupervised anomaly detection,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 993–1002

  41. [50]

    A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects,

    K. Song and Y . Yan, “A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects,”Applied Surface Science, vol. 285, pp. 858–864, 2013

  42. [51]

    Ssgd: A smartphone screen glass dataset for defect detection,

    H. Han, R. Yang, S. Li, R. Hu, and X. Li, “Ssgd: A smartphone screen glass dataset for defect detection,” inICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5

  43. [52]

    Vt-adl: A vision transformer network for image anomaly detection and localization,

    P. Mishra, R. Verk, D. Fornasier, C. Piciarelli, and G. L. Foresti, “Vt-adl: A vision transformer network for image anomaly detection and localization,” in2021 IEEE 30th International Symposium on Industrial Electronics (ISIE). IEEE, 2021, pp. 01–06

  44. [53]

    Be- yond dents and scratches: Logical constraints in unsupervised anomaly detection and localization,

    P. Bergmann, K. Batzner, M. Fauser, D. Sattlegger, and C. Steger, “Be- yond dents and scratches: Logical constraints in unsupervised anomaly detection and localization,”International Journal of Computer Vision, vol. 130, no. 4, pp. 947–969, 2022

  45. [54]

    Spot-the- difference self-supervised pre-training for anomaly detection and seg- mentation,

    Y . Zou, J. Jeong, L. Pemula, D. Zhang, and O. Dabeer, “Spot-the- difference self-supervised pre-training for anomaly detection and seg- mentation,” inEuropean Conference on Computer Vision. Springer, 2022, pp. 392–408

  46. [55]

    Vision datasets: A benchmark for vision- based industrial inspection,

    H. Bai, S. Mou, T. Likhomanenko, R. G. Cinbis, O. Tuzel, P. Huang, J. Shan, J. Shi, and M. Cao, “Vision datasets: A benchmark for vision- based industrial inspection,”arXiv preprint arXiv:2306.07890, 2023

  47. [56]

    Pku-goodsad: A supermarket goods dataset for unsupervised anomaly detection and segmentation,

    J. Zhang, R. Ding, M. Ban, and L. Dai, “Pku-goodsad: A supermarket goods dataset for unsupervised anomaly detection and segmentation,” IEEE Robotics and Automation Letters, 2024

  48. [57]

    Deep learning based steel pipe weld defect detection,

    D. Yang, Y . Cui, Z. Yu, and H. Yuan, “Deep learning based steel pipe weld defect detection,”Applied Artificial Intelligence, vol. 35, no. 15, pp. 1237–1249, 2021

  49. [58]

    Fabric inspection based on the elo rating method,

    C. S. Tsang, H. Y . Ngan, and G. K. Pang, “Fabric inspection based on the elo rating method,”Pattern Recognition, vol. 51, pp. 378–394, 2016

  50. [59]

    Segmentation- based deep-learning approach for surface-defect detection,

    D. Tabernik, S. Šela, J. Skvar ˇc, and D. Sko ˇcaj, “Segmentation- based deep-learning approach for surface-defect detection,”Journal of Intelligent Manufacturing, vol. 31, no. 3, pp. 759–776, 2020

  51. [60]

    Mixed supervision for surface- defect detection: From weakly to fully supervised learning,

    J. Boži ˇc, D. Tabernik, and D. Sko ˇcaj, “Mixed supervision for surface- defect detection: From weakly to fully supervised learning,”Comput- ers in Industry, vol. 129, p. 103459, 2021

  52. [61]

    Surface defect saliency of magnetic tile,

    Y . Huang, C. Qiu, and K. Yuan, “Surface defect saliency of magnetic tile,”The Visual Computer, vol. 36, no. 1, pp. 85–96, 2020

  53. [62]

    Imagenet: A large-scale hierarchical image database,

    J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009, pp. 248–255

  54. [63]

    Deep learning-based defect detection of metal parts: evaluating current meth- ods in complex conditions,

    S. Jezek, M. Jonak, R. Burget, P. Dvorak, and M. Skotak, “Deep learning-based defect detection of metal parts: evaluating current meth- ods in complex conditions,” in2021 13th International congress on ultra modern telecommunications and control systems and workshops (ICUMT). ...

  55. [64]

    Wide residual networks,

    S. Zagoruyko, “Wide residual networks,”arXiv preprint arXiv:1605.07146, 2016

  56. [65]

    Swin transformer: Hierarchical vision transformer using shifted windows,

    Z. Liu, Y . Lin, Y . Cao, H. Hu, Y . Wei, Z. Zhang, S. Lin, and B. Guo, “Swin transformer: Hierarchical vision transformer using shifted windows,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 10 012–10 022

  57. [66]

    Adam: A method for stochastic optimization,

    D. P. Kingma, “Adam: A method for stochastic optimization,”arXiv preprint arXiv:1412.6980, 2014

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.