Synthesis4AD: Synthetic Anomalies are All You Need for 3D Anomaly Detection
Pith reviewed 2026-05-10 19:57 UTC · model grok-4.3
The pith
Synthetic anomalies generated from product designs suffice to train state-of-the-art 3D anomaly detectors.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Synthesis4AD relies on 3D-DefectStudio and its MPAS synthesis engine to inject geometrically realistic defects into 3D point clouds using higher-dimensional support primitives while automatically producing accurate anomaly masks, with a multimodal large language model converting product design information into synthesis instructions, followed by a training stage that applies spatial-distribution normalization and geometry-faithful augmentations to improve Point Transformer robustness on unstructured data.
What carries the argument
MPAS controllable synthesis engine that injects defects guided by higher-dimensional support primitives to produce point-wise anomaly masks in 3D point clouds.
If this is right
- Anomaly detectors can be trained without collecting or labeling rare real defect samples.
- The same synthesis pipeline applies across different industrial parts without manual annotation effort.
- Point Transformer models become less sensitive to absolute coordinate shifts in real scans.
- Scalable generation supports training on far more defect variations than available in real data.
Where Pith is reading between the lines
- The same synthesis approach could shorten development time for inspection systems on new product lines by reusing design information.
- Public release of the synthesis tools may let other researchers create consistent benchmark datasets for comparing anomaly methods.
- The method might reduce reliance on expensive real-world data collection in related tasks such as surface defect inspection or assembly verification.
Load-bearing premise
The synthetic anomalies produced by the MPAS engine match the geometry and distribution of real defects closely enough for models trained only on them to generalize to actual industrial test data.
What would settle it
A direct comparison where a detector trained exclusively on the synthetic anomalies is evaluated on a fresh collection of real industrial defects and shows detection accuracy no higher than a detector trained on a modest set of actual anomalies.
Figures
read the original abstract
Industrial 3D anomaly detection performance is fundamentally constrained by the scarcity and long-tailed distribution of abnormal samples. To address this challenge, we propose Synthesis4AD, an end-to-end paradigm that leverages large-scale, high-fidelity synthetic anomalies to learn more discriminative representations for 3D anomaly detection. At the core of Synthesis4AD is 3D-DefectStudio, a software platform built upon the controllable synthesis engine MPAS, which injects geometrically realistic defects guided by higher-dimensional support primitives while simultaneously generating accurate point-wise anomaly masks. Furthermore, Synthesis4AD incorporates a multimodal large language model (MLLM) to interpret product design information and automatically translate it into executable anomaly synthesis instructions, enabling scalable and knowledge-driven anomalous data generation. To improve the robustness and generalization of the downstream detector on unstructured point clouds, Synthesis4AD further introduces a training pipeline based on spatial-distribution normalization and geometry-faithful data augmentations, which alleviates the sensitivity of Point Transformer architectures to absolute coordinates and improves feature learning under realistic data variations. Extensive experiments demonstrate state-of-the-art performance on Real3D-AD, MulSen-AD, and a real-world industrial parts dataset. The proposed synthesis method MPAS and the interactive system 3D-DefectStudio will be publicly released at https://github.com/hustCYQ/Synthesis4AD.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Synthesis4AD, an end-to-end framework for 3D anomaly detection that generates large-scale synthetic anomalies via the MPAS controllable synthesis engine inside the 3D-DefectStudio platform; MPAS injects geometrically realistic defects using higher-dimensional support primitives and point-wise masks, with MLLM interpreting product design information to produce scalable synthesis instructions. A downstream training pipeline applies spatial-distribution normalization and geometry-faithful augmentations to a Point Transformer to improve robustness on unstructured point clouds. The manuscript reports state-of-the-art results on Real3D-AD, MulSen-AD, and a real-world industrial parts dataset, with public release of MPAS and 3D-DefectStudio planned.
Significance. If the MPAS-generated anomalies are distributionally close enough to real defects to produce the claimed generalization gains, the work would meaningfully address the long-tailed anomaly data problem in industrial 3D anomaly detection. The planned open release of the synthesis engine and interactive studio constitutes a concrete contribution to reproducibility and follow-on research.
major comments (2)
- [Experiments (likely §5) and Method (§3)] The SOTA claims on Real3D-AD, MulSen-AD, and the industrial dataset rest on the premise that MPAS synthetics (primitive-guided injection plus MLLM instructions) are sufficiently representative of real defects; however, no quantitative distributional comparison (Chamfer/EMD distances, curvature histograms, or feature-space alignment metrics) between synthetic and real anomaly point clouds is reported in the experimental section, leaving open whether gains derive from true realism or from data volume and tuning.
- [Results section] Table or figure reporting the main results should include explicit baseline methods, exact metrics (AUROC, AUPRO, etc.), and ablations isolating the contribution of MPAS realism versus the spatial normalization/augmentation pipeline; without these, the magnitude and source of the reported improvements cannot be verified.
minor comments (2)
- [Abstract] The abstract states that MPAS and 3D-DefectStudio will be released but does not specify the exact license or repository structure; adding this detail would strengthen the reproducibility claim.
- [Method and Experiments] Ensure consistent notation for point-wise anomaly masks and spatial normalization across method and experiments sections.
Simulated Author's Rebuttal
We thank the referee for the constructive comments, which identify key areas to strengthen the validation of our synthetic anomaly approach. We address each major point below and will revise the manuscript to incorporate the requested analyses and clarifications.
read point-by-point responses
-
Referee: [Experiments (likely §5) and Method (§3)] The SOTA claims on Real3D-AD, MulSen-AD, and the industrial dataset rest on the premise that MPAS synthetics (primitive-guided injection plus MLLM instructions) are sufficiently representative of real defects; however, no quantitative distributional comparison (Chamfer/EMD distances, curvature histograms, or feature-space alignment metrics) between synthetic and real anomaly point clouds is reported in the experimental section, leaving open whether gains derive from true realism or from data volume and tuning.
Authors: We agree that explicit quantitative distributional comparisons would provide stronger evidence for the realism of MPAS synthetics. The current manuscript demonstrates effectiveness through SOTA results on real datasets, but does not include direct metrics such as Chamfer distance, EMD, curvature histograms, or feature-space alignment. In the revised version, we will add a new experimental subsection reporting these comparisons between synthetic and real anomaly point clouds, along with discussion of how they indicate that performance gains stem from distributional similarity rather than data volume alone. revision: yes
-
Referee: [Results section] Table or figure reporting the main results should include explicit baseline methods, exact metrics (AUROC, AUPRO, etc.), and ablations isolating the contribution of MPAS realism versus the spatial normalization/augmentation pipeline; without these, the magnitude and source of the reported improvements cannot be verified.
Authors: We concur that clearer presentation of baselines, metrics, and ablations is needed for verifiability. The revised manuscript will update the primary results tables and figures to explicitly list all baseline methods with exact metrics (AUROC, AUPRO, and others as used). We will also add ablation studies that isolate the individual contributions of MPAS synthesis, spatial-distribution normalization, and geometry-faithful augmentations, enabling readers to assess the source and magnitude of improvements. revision: yes
Circularity Check
No significant circularity in claimed derivation
full rationale
The paper describes an empirical pipeline: MPAS primitive-guided synthesis of anomalies, MLLM instruction translation, spatial normalization + augmentations, and Point Transformer training, followed by direct evaluation on external benchmarks (Real3D-AD, MulSen-AD, industrial dataset). No equations, fitted parameters, or self-citations are presented that reduce the SOTA claim to a tautology or to quantities fitted on the target test distributions themselves. The central performance result is therefore not forced by construction from the inputs.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption High-fidelity synthetic anomalies generated from higher-dimensional support primitives will produce point-wise masks and geometries that improve real-world detector robustness
invented entities (2)
-
MPAS
no independent evidence
-
3D-DefectStudio
no independent evidence
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/RealityFromDistinction.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
MPAS anchors deformation generation on supporting primitives... 1D/2D/3D levels... convex hull-guided mask generation... local parametric surface distortion
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Spatial-Distribution Normalization (SDN)... category-level bounding sphere... voxel downsampling with unified voxel resolution
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Hui Zhang, Zheng Wang, Dan Zeng, Zuxuan Wu, and Yu-Gang Jiang. Diffusionad: Norm-guided one-step denoising diffusion for anomaly detection.IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 2025
work page 2025
-
[2]
Haiming Yao, Wei Luo, Yunkang Cao, Yiheng Zhang, Wenyong Yu, and Weiming Shen. Global-regularized neighborhood regression for efficient zero-shot texture anomaly detection.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2025
work page 2025
-
[3]
Yunkang Cao, Xiaohao Xu, Yuqi Cheng, Chen Sun, Zongwei Du, Liang Gao, and Weiming Shen. Personalizing vision-language models with hybrid prompts for zero-shot anomaly detection.IEEE Transactions on Cybernetics, 55(4):1917–1929, 2025
work page 1917
-
[4]
Qiyu Chen, Huiyuan Luo, Han Gao, Chengkan Lv, and Zhengtao Zhang. Progressive boundary guided anomaly synthesis for industrial anomaly detection.IEEE Transactions on Circuits and Systems for Video Technology, 2024
work page 2024
-
[5]
Ye Liu, Yuanrong Tian, Yunlong Mi, Hui Liu, Jianqiang Wang, and Witold Pedrycz. Landmark block-embedded aggregation autoencoder for anomaly detection.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024
work page 2024
-
[6]
Chengjie Wang, Haokun Zhu, Jinlong Peng, Yue Wang, Ran Yi, Yun- sheng Wu, Lizhuang Ma, and Jiangning Zhang. M3dm-nr: Rgb-3d noisy- resistant industrial anomaly detection via multimodal denoising.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
work page 2025
-
[7]
Yunkang Cao, Xiaohao Xu, Chen Sun, Liang Gao, and Weiming Shen. Bias: Incorporating biased knowledge to boost unsupervised image anomaly localization.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54(4):2342–2353, 2024
work page 2024
-
[8]
Yutong Wang, Jiangong Wang, Yansong Cao, Shixing Li, and Oliver Kwan. Integrated inspection on pcb manufacturing in cyber–physical–social systems.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(4):2098–2106, 2023. doi: 10.1109/TSMC.2022.3229096. 14
-
[9]
Deep industrial image anomaly detection: A survey.Machine Intelligence Research, 21(1):104–135, 2024
Jiaqi Liu, Guoyang Xie, Jinbao Wang, Shangnian Li, Chengjie Wang, Feng Zheng, and Yaochu Jin. Deep industrial image anomaly detection: A survey.Machine Intelligence Research, 21(1):104–135, 2024
work page 2024
-
[10]
Chao Huang, Zehua Yang, Jie Wen, Yong Xu, Qiuping Jiang, Jian Yang, and Yaowei Wang. Self-supervision-augmented deep autoencoder for un- supervised visual anomaly detection.IEEE Transactions on Cybernetics, 52(12):13834–13847, 2022. doi: 10.1109/TCYB.2021.3127716
-
[11]
Jielin Jiang, Jiale Zhu, Muhammad Bilal, Yan Cui, Neeraj Kumar, Ruihan Dou, Feng Su, and Xiaolong Xu. Masked swin transformer unet for industrial anomaly detection.IEEE Transactions on Industrial Informatics, 19(2):2200–2209, 2022. doi: 10.1109/TII.2022.3199228
-
[12]
Collabo- rative discrepancy optimization for reliable image anomaly localization
Yunkang Cao, Xiaohao Xu, Zhaoge Liu, and Weiming Shen. Collabo- rative discrepancy optimization for reliable image anomaly localization. IEEE Transactions on Industrial Informatics, pages 1–10, 2023. doi: 10.1109/TII.2023.3241579
-
[13]
Hongze Zhu, Guoyang Xie, Chengbin Hou, Tao Dai, Can Gao, Jinbao Wang, and Linlin Shen. Towards high-resolution 3d anomaly detection via group-level feature contrastive learning.ACM Multimedia (ACM MM), 2024
work page 2024
-
[14]
R3d-ad: Reconstruction via diffusion for 3d anomaly detection
Zheyuan Zhou, Le Wang, Naiyu Fang, Zili Wang, Lemiao Qiu, and Shuyou Zhang. R3d-ad: Reconstruction via diffusion for 3d anomaly detection. InEuropean Conference on Computer Vision (ECCV), 2024
work page 2024
-
[15]
Yuqi Cheng, Yunkang Cao, Dongfang Wang, Weiming Shen, and Wen- long Li. Boosting global-local feature matching via anomaly synthesis for multi-class point cloud anomaly detection.IEEE Transactions on Automation Science and Engineering, 22:12560–12571, 2025
work page 2025
-
[16]
Hanzhe Liang, Aoran Wang, Jie Zhou, Xin Jin, Can Gao, and Jinbao Wang. Examining the source of defects from a mechanical perspective for 3d anomaly detection.arXiv preprint arXiv:2505.05901, 2025
-
[17]
Exploiting point-language models with dual- prompts for 3d anomaly detection.Expert Syst
Jiaxiang Wang, Haote Xu, Xiaolu Chen, Haodi Xu, Yue Huang, Xinghao Ding, and Xiaotong Tu. Exploiting point-language models with dual- prompts for 3d anomaly detection.Expert Syst. Appl., 298:129758, 2025
work page 2025
-
[18]
Yuqi Cheng, Yihan Sun, Hui Zhang, Weiming Shen, and Yunkang Cao. Towards high-resolution 3d anomaly detection: A scalable dataset and real-time framework for subtle industrial defects.AAAI, 2026
work page 2026
-
[19]
Jiayi Cheng, Can Gao, Jie Zhou, Jiajun Wen, Tao Dai, and Jinbao Wang. Mc3d-ad: A unified geometry-aware reconstruction model for multi-category 3d anomaly detection.arXiv preprint arXiv:2505.01969, 2025
-
[20]
Back to the feature: classical 3d features are (almost) all you need for 3d anomaly detection
Eliahu Horwitz and Yedid Hoshen. Back to the feature: classical 3d features are (almost) all you need for 3d anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2967–2976, 2023
work page 2023
-
[21]
Multimodal industrial anomaly detection via hybrid fusion
Yue Wang, Jinlong Peng, Jiangning Zhang, Ran Yi, Yabiao Wang, and Chengjie Wang. Multimodal industrial anomaly detection via hybrid fusion. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8032–8041, 2023
work page 2023
-
[22]
Yatian Pang, Eng Hock Francis Tay, Li Yuan, and Zhenghua Chen. Masked autoencoders for 3d point cloud self-supervised learning.World Scientific Annual Review of Artificial Intelligence, 1:2440001, 2023
work page 2023
-
[23]
Yunkang Cao, Xiaohao Xu, and Weiming Shen. Complementary pseudo multimodal feature for point cloud anomaly detection.Pattern Recognition, 156:110761, 2024
work page 2024
-
[24]
Yuqi Cheng, Yunkang Cao, Guoyang Xie, Zhichao Lu, and Weiming Shen. Towards zero-shot point cloud anomaly detection: A multi- view projection framework.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024
work page 2024
-
[25]
Look inside for more: Internal spatial modality perception for 3d anomaly detection
Hanzhe Liang, Guoyang Xie, Chengbin Hou, Bingshu Wang, Can Gao, and Jinbao Wang. Look inside for more: Internal spatial modality perception for 3d anomaly detection. InProceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 5146–5154, 2025
work page 2025
-
[26]
Qihang Zhou, Jiangtao Yan, Shibo He, Wenchao Meng, and Jiming Chen. Pointad: Comprehending 3d anomalies from points and pixels for zero-shot 3d anomaly detection.NeurIPS, 2024
work page 2024
-
[27]
Real3d-ad: A dataset of point cloud anomaly detection
Jiaqi Liu, Guoyang Xie, Xinpeng Li, Jinbao Wang, Yong Liu, Chengjie Wang, Feng Zheng, et al. Real3d-ad: A dataset of point cloud anomaly detection. InThirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, volume 36, 2024
work page 2024
-
[28]
Registration based few-shot anomaly detection
Chaoqin Huang, Haoyan Guan, Aofan Jiang, Ya Zhang, Michael Spratling, and Yan-Feng Wang. Registration based few-shot anomaly detection. InEuropean Conference on Computer Vision, pages 303–
-
[29]
Karsten Roth, Latha Pemula, Joaquin Zepeda, Bernhard Sch ¨olkopf, Thomas Brox, and Peter Gehler. Towards total recall in industrial anomaly detection. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14318–14328, 2022. doi: 10.1109/CVPR52688.2022.01392
-
[30]
Huijun Gao, Chao Ye, Weiyang Lin, and Jianbin Qiu. Complex workpiece positioning system with nonrigid registration method for 6- dofs automatic spray painting robot.IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(12):7305–7313, 2020
work page 2020
-
[31]
Yuqi Cheng, Wenlong Li, Cheng Jiang, Dongfang Wang, Hongwen Xing, and Wei Xu. MVGR: Mean-variance minimization global registration method for multi-view point cloud in robot inspection.IEEE Transac- tions on Instrumentation and Measurement, pages 1–1, 2024
work page 2024
-
[32]
Anomaly detection in 3d point clouds using deep geometric descriptors
Paul Bergmann and David Sattlegger. Anomaly detection in 3d point clouds using deep geometric descriptors. In2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 2612– 2622, 2023
work page 2023
-
[33]
Shape-guided dual-memory learning for 3d anomaly detection
Yu-Min Chu, Chieh Liu, Ting-I Hsieh, Hwann-Tzong Chen, and Tyng- Luh Liu. Shape-guided dual-memory learning for 3d anomaly detection. InProceedings of the 40th International Conference on Machine Learn- ing, pages 6185–6194, 2023
work page 2023
-
[34]
Anomagic: Crossmodal prompt-driven zero- shot anomaly generation.AAAI, 2026
Yuxin Jiang, Wei Luo, Hui Zhang, Qiyu Chen, Haiming Yao, Weiming Shen, and Yunkang Cao. Anomagic: Crossmodal prompt-driven zero- shot anomaly generation.AAAI, 2026
work page 2026
-
[35]
Dual- interrelated diffusion model for few-shot anomaly image generation
Ying Jin, Jinlong Peng, Qingdong He, Teng Hu, Jiafu Wu, Hao Chen, Haoxuan Wang, Wenbing Zhu, Mingmin Chi, Jun Liu, et al. Dual- interrelated diffusion model for few-shot anomaly image generation. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 30420–30429, 2025
work page 2025
-
[36]
Few-shot anomaly-driven generation for anomaly classification and segmentation
Guan Gui, Bin-Bin Gao, Jun Liu, Chengjie Wang, and Yunsheng Wu. Few-shot anomaly-driven generation for anomaly classification and segmentation. InEuropean conference on computer vision, pages 210–
-
[37]
Defectfill: Realistic defect generation with inpainting diffusion model for visual inspection
Jaewoo Song, Daemin Park, Kanghyun Baek, Sangyub Lee, Jooyoung Choi, Eunji Kim, and Sungroh Yoon. Defectfill: Realistic defect generation with inpainting diffusion model for visual inspection. InPro- ceedings of the Computer Vision and Pattern Recognition Conference, pages 18718–18727, 2025
work page 2025
-
[38]
Po3ad: Predicting point offsets toward better 3d point cloud anomaly detection
Jianan Ye, Weiguang Zhao, Xi Yang, Guangliang Cheng, and Kaizhu Huang. Po3ad: Predicting point offsets toward better 3d point cloud anomaly detection. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 1353–1362, 2025
work page 2025
-
[39]
Philip L Frana and Thomas J Misa. An interview with edsger w. dijkstra. Communications of the ACM, 53(8):41–47, 2010
work page 2010
-
[40]
C Bradford Barber, David P Dobkin, and Hannu Huhdanpaa. The quick- hull algorithm for convex hulls.ACM Transactions on Mathematical Software (TOMS), 22(4):469–483, 1996
work page 1996
-
[41]
Principal components analysis (pca).Computers & Geosciences, 19(3):303–342, 1993
Andrzej Ma ´ckiewicz and Waldemar Ratajczak. Principal components analysis (pca).Computers & Geosciences, 19(3):303–342, 1993
work page 1993
-
[42]
Wenqiao Li, Bozhong Zheng, Xiaohao Xu, Jinye Gan, Fading Lu, Xiang Li, Na Ni, Zheng Tian, Xiaonan Huang, Shenghua Gao, et al. Multi- sensor object anomaly detection: Unifying appearance, geometry, and internal properties.arXiv preprint arXiv:2412.14592, 2024
-
[43]
Gemini: A Family of Highly Capable Multimodal Models
Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, Katie Millican, et al. Gemini: a family of highly capable multimodal models.arXiv preprint arXiv:2312.11805, 2023
work page internal anchor Pith review Pith/arXiv arXiv 2023
-
[44]
Fast point feature histograms (fpfh) for 3d registration
Radu Bogdan Rusu, Nico Blodow, and Michael Beetz. Fast point feature histograms (fpfh) for 3d registration. In2009 IEEE international conference on robotics and automation, pages 3212–3217. IEEE, 2009
work page 2009
-
[45]
Wenqiao Li and Xiaohao Xu. Towards scalable 3d anomaly detection and localization: A benchmark via 3d anomaly synthesis and a self- supervised learning network.2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
work page 2024
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.