REVIEW 4 major objections 6 minor 19 references
An unsupervised method segments integrated-circuit defects using only the normal patterns already inside the test image, removing the need for external reference samples.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-04 19:10 UTC pith:IOV4FX4P
load-bearing objection Per-image normal-token extraction for IC defect segmentation is a real step past support-set methods, but the unspecified pseudo-defect synthesis is load-bearing and the numbers need error bars before the central claim can be trusted. the 4 major comments →
Unsupervised Integrated-Circuit Defect Segmentation via Image-Intrinsic Normality
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that defects in IC SEM imagery are predominantly local, and thus each defective image still contains enough repeatable normal structure to serve as its own reference. To exploit this, the paper introduces a learnable Normal-Information Extractor that aggregates representative normal features from the test image via cross-attention, and a Normal-Information-Guided Decoder that reconstructs local features using those normal tokens as keys and values. The residual between reconstructed and original features segments defects. A coherence loss ties the extracted normal tokens to truly normal regions, and a pseudo-anomaly augmentation stabilizes training. The method does not c
What carries the argument
The key mechanism is the pair of a Normal-Information (NI) Extractor and a Normal-Information-Guided (NIG) Decoder. The NI extractor uses a pretrained ViT backbone and a small set of learnable normal tokens that attend to multi-layer features, producing M=6 prototype tokens meant to encode the image's own normality. The NIG decoder injects these tokens as keys and values so that reconstruction is biased toward normal content; a cosine-distance coherence loss forces normal tokens to be close to normal regions and far from pseudo-defect regions, and a reconstruction loss with gradient weighting emphasizes hard normal regions. The reconstruction residual itself is the defect score, avoiding dir
Load-bearing premise
The method assumes that synthetic pseudo-defects pasted onto training images resemble real IC defects closely enough that a model trained to reconstruct only normal regions will also suppress genuine defects at test time; this assumption is load-bearing and is not validated or even described in detail in the paper.
What would settle it
A concrete falsifying test: if training is performed without the pseudo-defect augmentation and the method's segmentation performance does not degrade, then the synthesis assumption is not necessary; conversely, if a dataset with defects covering large contiguous areas (e.g., a scratch spanning half the image) causes the method to fail, the image-intrinsic normality prior is invalid for such cases.
If this is right
- If the method works as claimed, wafer inspection could run per-image without maintaining a reference library, simplifying deployment across products and process stages.
- The framework could generalize to other domains where defects are local and backgrounds are highly structured but repeatable, such as textile, metal surface, or reticle inspection.
- The reconstruction residual provides a pixel-level defect map without needing pixel annotations, only image-level pseudo-defect synthesis during training.
- The method's few-shot performance suggests it can adapt to new process stages with very few annotated samples, potentially cutting data collection costs.
- Because the normal tokens are derived from the test image itself, the approach is inherently tolerant to layout and illumination shifts that would break alignment-based support-set methods.
Where Pith is reading between the lines
- A likely implicit consequence is that the method's success depends on the defect-to-normal-region ratio in each image: if a defect covers a large fraction of the image, the extracted normal tokens would be contaminated and the residual would weaken; the paper does not quantify this limit, but it follows directly from the image-intrinsic normality prior.
- The pseudo-defect synthesis procedure is the main uncontrolled variable: since the paper does not describe how pseudo-defects are generated, a straightforward testable extension would be to compare different synthesis strategies (e.g., random patches vs. realistic defect patterns) and measure how strongly the final segmentation accuracy depends on that choice.
- One could test the robustness claim directly by creating a 'defect-only' variant of the dataset where normal patterns are largely absent, predicting that the method's performance will degrade sharply; the paper does not report such a stress test.
- If the normal tokens are truly global summaries, the method should be invariant to token count beyond a saturation point; the paper's own ablation on M suggests that performance saturates, which is consistent with the global-normal-prototype interpretation but also implies that very fine-grained local defects may be missed when they are smaller than the token attention resolution.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes an unsupervised IC defect segmentation framework that, at inference time, extracts 'normal information' from the test image itself via a learnable cross-attention normal-token extractor, and uses a normal-information-guided decoder to reconstruct normal-region features. Defects are segmented from the residual between reconstructed and original features. Training uses normal images and synthesized pseudo-defects with their binary masks; a coherence loss associates the normal tokens with normal regions. Experiments on three private SEM datasets (BEOL, DEP, DPR) report image-level and pixel-level AUROC improvements over several CLIP-based and reconstruction baselines, together with a k-shot study and an ablation of the normal-token count.
Significance. If the central claim holds, the idea of exploiting image-intrinsic normal patterns rather than external support-set alignment is a useful and nontrivial contribution for structured IC imagery. The paper evaluates against a reasonable set of baselines and includes a few-shot study. However, the verification is currently incomplete: the datasets and code are not released, the pseudo-defect synthesis is specified in one sentence, and the reported numbers are single runs without error bars or significance tests. These gaps prevent the reader from checking whether the reported gains are due to the proposed normality mechanism or to the unspecified synthetic-defect protocol.
major comments (4)
- [§2.1] The pseudo-defect synthesis is load-bearing but undescribed. The text says only 'pseudo defects and their corresponding binary masks are synthesized on the training image.' Both L_normal and the reconstruction training depend on these masks, so the model learns a decision boundary around this synthetic artifact class. The paper gives no protocol (shape, size, intensity, placement, number, per-image vs. global), no visual examples, and no ablation varying the synthesis parameters. Without this, the reported p-AUROC gains could be an artifact of the synthetic prior rather than image-intrinsic normality. Please specify the synthesis distribution and validate its match to real defects with ablations or qualitative examples.
- [§2.1, Eqs. (3)–(5)] The L_normal formulation is internally inconsistent. The text says distance_cos denotes cosine similarity, but d+ is called 'distance to the nearest normal patch token.' If distance_cos is cosine similarity, then minimizing d+ in the first term pushes normal tokens away from normal features, contradicting the stated goal of associating normal information with normal regions. If a cosine distance is intended, it should be written as 1 − similarity. Also, α≥0 appears in Eq. (5) but α is not used in the loss. Please correct the definition and remove dangling notation.
- [Tables 1–3] The reported numbers for the proposed method are inconsistent. Table 1 gives Ours DPR p-AUROC = 96.62, while Table 2 and Table 3 full-shot give DPR p-AUROC = 94.62 for the same configuration. This discrepancy changes the margin over MUSC (94.12) and must be reconciled. If the tables report different runs or model versions, that needs to be stated.
- [§3.1 and Table 1] The empirical claim of 'consistent improvements' is supported only by single-point AUROC estimates. No standard deviations, confidence intervals, or significance tests are reported. Given the small dataset sizes and the multiple hyperparameters (M, λ, γ, pseudo-defect settings), the reader cannot judge whether the gains are stable. Please provide results over multiple seeds or otherwise characterize variability, and specify the train/test splitting and annotation protocol so the three-dataset evaluation is reproducible.
minor comments (6)
- [§2.2, Eq. (7)] The notation cg(·) is undefined. If it denotes a stop-gradient or gradient-modulation operator, define it explicitly; otherwise the loss expression is not reproducible.
- [§2.2] The name 'INP-Former' appears for the first time in the loss description without definition. Either introduce it in the method overview or use consistent terminology.
- [§3.2, ablation text] The text references 'Figure 6' but no Figure 6 is present in the manuscript. The relevant visual comparison appears to be Figure 4.
- [§2.1] The term 'normal informations' is nonstandard English; use 'normal information' or 'normal features' throughout.
- [§3.2, Table 3] The k-shot setting is not defined: does k=1 mean one training image per defect class, one normal image total, or one image per process stage? Specify the protocol and how pseudo-defects are generated under such limited training data.
- [§3, Dataset] The dataset description is minimal: 2990 SEM images across three stages, but no details on image resolution, defect types, class balance, or ground-truth annotation procedure are given. This hinders comparison and reproducibility.
Circularity Check
No significant circularity: the training and inference chain is self-contained and the main claim is benchmarked against external baselines.
full rationale
The paper's derivation chain is not circular. The Normal-Information (NI) extractor is trained with a coherence loss L_normal that separates features of normal regions from pseudo-defect regions using synthesized masks, and the NIG decoder is trained with a reconstruction loss L_rc. These losses define a training procedure, not the test-time prediction. At inference, defects are obtained from the residual between reconstructed features and original features; the pseudo-defect masks are not reused as test outputs. The method is evaluated against real defect labels on three IC process stages and compared with external baselines, including DINOv2 features from independent pretraining. The only self-citation is MAE-IC [10], which appears solely as a baseline in Table 1 and in the introduction; it is not load-bearing for the proposed method, and it does not supply a uniqueness theorem or an ansatz. No parameter is fitted to the test labels, and the hyperparameters (gamma, lambda, M) are fixed, with ablations reported. The main limitation noted by a skeptical reader is that the pseudo-defect synthesis is not described in detail and its representativeness is not validated; this is a reproducibility/validity concern, not circularity. There is no equation or construction by which the predicted defect residual is equivalent to the training pseudo-masks or to any fitted input, so the central claim retains independent content.
Axiom & Free-Parameter Ledger
free parameters (4)
- Number of normal tokens M =
6
- Coherence loss weight lambda =
0.2
- Gradient temperature gamma =
3.0
- Pseudo-defect generation protocol =
unspecified
axioms (3)
- domain assumption Defects are predominantly local and each SEM image contains rich, repeatable normal patterns that cover most of the image.
- ad hoc to paper Synthetic pseudo-defects are a reliable proxy for real IC defects in training.
- domain assumption DINOv2-R features, pretrained on natural images, preserve local normal-vs-defect discriminative structure in IC SEM images.
read the original abstract
Modern Integrated-Circuit(IC) manufacturing introduces diverse, fine-grained defects that depress yield and reliability. Most industrial defect segmentation compares a test image against an external normal set, a strategy that is brittle for IC imagery where layouts vary across products and accurate alignment is difficult. We observe that defects are predominantly local, while each image still contains rich, repeatable normal patterns. We therefore propose an unsupervised IC defect segmentation framework that requires no external normal support. A learnable normal-information extractor aggregates representative normal features from the test image, and a coherence loss enforces their association with normal regions. Guided by these features, a decoder reconstructs only normal content; the reconstruction residual then segments defects. Pseudo-anomaly augmentation further stabilizes training. Experiments on datasets from three IC process stages show consistent improvements over existing approaches and strong robustness to product variability.
Reference graph
Works this paper leans on
-
[1]
Each step may introduce various defects
INTRODUCTION The fabrication of IC involves hundreds of steps, such as dummy poly removal, etching, and chemical-mechanical polishing. Each step may introduce various defects. Effi- cient management and control of wafer defects is critical for yield improvement. However, scanning electron mi- croscope (SEM) images of wafer surfaces exhibit complex backgro...
Pith/arXiv arXiv 2025
-
[2]
METHOD Existing methods rely on normal features from a support set and compare them against the test image. However, due to the complex backgrounds of IC, these normal features are diffi- cult to directly align with the local features of the test im- age, especially under the interference of global semantics and positional encodings. As illustrated in Fig...
-
[3]
Implementation Details:We use ViT-Base/14 with DINOv2-R pre-trained weights [14] as the default encoder
EXPERIMENT Dataset.In this study, our dataset comprises 2990 SEM im- ages across three process stages: back end of line (BEOL) with 1290 images, deposition (DEP) with 775 images, and dummy poly remove (DPR) with 925 images. Implementation Details:We use ViT-Base/14 with DINOv2-R pre-trained weights [14] as the default encoder. The number of normal tokens ...
-
[4]
A learnable normal information extractor distills stable and representative features of normal regions
CONCLUSION In this paper, we propose an unsupervised IC defect seg- mentation framework that does not rely on external normal references by extracting image intrinsic normal information from the test image. A learnable normal information extractor distills stable and representative features of normal regions. Guided by these features, a decoder reconstruc...
-
[5]
Musc: Zero-shot industrial anomaly classification and segmentation with mutual scoring of the unlabeled im- ages,
Xurui Li, Ziming Huang, Feng Xue, and Yu Zhou, “Musc: Zero-shot industrial anomaly classification and segmentation with mutual scoring of the unlabeled im- ages,” inThe Twelfth International Conference on Learning Representations, 2024
2024
-
[6]
Winclip: Zero-/few-shot anomaly classification and segmentation,
Jongheon Jeong, Yang Zou, Taewan Kim, Dongqing Zhang, Avinash Ravichandran, and Onkar Dabeer, “Winclip: Zero-/few-shot anomaly classification and segmentation,” inProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, 2023, pp. 19606–19616
2023
-
[7]
A reconstruction-based feature adaptation for anomaly detection with self-supervised multi-scale ag- gregation,
Zuo Zuo, Zongze Wu, Badong Chen, and Xiaopin Zhong, “A reconstruction-based feature adaptation for anomaly detection with self-supervised multi-scale ag- gregation,” inICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2024, pp. 5840–5844
2024
-
[8]
Transfusion–a transparency-based diffusion model for anomaly detection,
Matic Fu ˇcka, Vitjan Zavrtanik, and Danijel Sko ˇcaj, “Transfusion–a transparency-based diffusion model for anomaly detection,” inEuropean conference on com- puter vision. Springer, 2024, pp. 91–108
2024
-
[9]
Glad: Towards better reconstruction with global and local adaptive diffusion models for unsupervised anomaly detection,
Hang Yao, Ming Liu, Zhicun Yin, Zifei Yan, Xiaopeng Hong, and Wangmeng Zuo, “Glad: Towards better reconstruction with global and local adaptive diffusion models for unsupervised anomaly detection,” inEuro- pean Conference on Computer Vision. Springer, 2024, pp. 1–17
2024
-
[10]
A diffusion-based framework for multi-class anomaly detection,
Haoyang He, Jiangning Zhang, Hongxu Chen, Xuhai Chen, Zhishan Li, Xu Chen, Yabiao Wang, Chengjie Wang, and Lei Xie, “A diffusion-based framework for multi-class anomaly detection,” inProceedings of the AAAI conference on artificial intelligence, 2024, vol. 38, pp. 8472–8480
2024
-
[11]
Aa-clip: Enhancing zero-shot anomaly detection via anomaly-aware clip,
Wenxin Ma, Xu Zhang, Qingsong Yao, Fenghe Tang, Chenxu Wu, Yingtai Li, Rui Yan, Zihang Jiang, and S Kevin Zhou, “Aa-clip: Enhancing zero-shot anomaly detection via anomaly-aware clip,” inProceedings of the Computer Vision and Pattern Recognition Confer- ence, 2025, pp. 4744–4754
2025
-
[12]
Anomalygpt: Detecting industrial anomalies using large vision-language mod- els,
Zhaopeng Gu, Bingke Zhu, Guibo Zhu, Yingying Chen, Ming Tang, and Jinqiao Wang, “Anomalygpt: Detecting industrial anomalies using large vision-language mod- els,” inProceedings of the AAAI conference on artificial intelligence, 2024, vol. 38, pp. 1932–1940
2024
-
[13]
Promp- tad: Learning prompts with only normal samples for few-shot anomaly detection,
Xiaofan Li, Zhizhong Zhang, Xin Tan, Chengwei Chen, Yanyun Qu, Yuan Xie, and Lizhuang Ma, “Promp- tad: Learning prompts with only normal samples for few-shot anomaly detection,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 16838–16848
2024
-
[14]
A masked autoencoder-based approach for de- fect classification in semiconductor manufacturing,
Hu Lu, Jiwei Shen, Botong Zhao, Pengjie Lou, Wen- zhan Zhou, Kan Zhou, Xintong Zhao, Shujing Lyu, and Yue Lu, “A masked autoencoder-based approach for de- fect classification in semiconductor manufacturing,” in 2023 International Workshop on Advanced Patterning Solutions (IWAPS). IEEE, 2023, pp. 1–4
2023
-
[15]
A novel joint segmentation approach for wafer surface defect classification based on blended net- work structure,
Zhouzhouzhou Mei, Yuening Luo, Yibo Qiao, and Yin- ing Chen, “A novel joint segmentation approach for wafer surface defect classification based on blended net- work structure,”Journal of Intelligent Manufacturing, vol. 36, no. 3, pp. 1907–1921, 2025
1907
-
[16]
Deepsem-net: Enhancing sem defect analy- sis in semiconductor manufacturing with a dual-branch cnn-transformer architecture,
Yibo Qiao, Zhouzhouzhou Mei, Yuening Luo, and Yin- ing Chen, “Deepsem-net: Enhancing sem defect analy- sis in semiconductor manufacturing with a dual-branch cnn-transformer architecture,”Computers & Industrial Engineering, vol. 193, pp. 110301, 2024
2024
-
[17]
Fabgpt: An efficient large multimodal model for complex wafer defect knowledge queries,
Yuqi Jiang, Xudong Lu, Qian Jin, Qi Sun, Hanming Wu, and Cheng Zhuo, “Fabgpt: An efficient large multimodal model for complex wafer defect knowledge queries,” inProceedings of the 43rd IEEE/ACM Inter- national Conference on Computer-Aided Design, 2024, pp. 1–8
2024
-
[18]
Dinov2: Learning robust visual features without supervision,
Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fer- nandez, Daniel Haziza, Francisco Massa, Alaaeldin El- Nouby, et al., “Dinov2: Learning robust visual features without supervision,”arXiv preprint arXiv:2304.07193, 2023
Pith/arXiv arXiv 2023
-
[19]
Anomalyclip: Object-agnostic prompt learning for zero-shot anomaly detection,
Qihang Zhou, Guansong Pang, Yu Tian, Shibo He, and Jiming Chen, “Anomalyclip: Object-agnostic prompt learning for zero-shot anomaly detection,” 2025
2025
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.