REVIEW 4 major objections 5 minor 30 references
DAPAS : Denoising Autoencoder to Prevent Adversarial attack in Semantic Segmentation
T0 review · 4 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read A denoising autoencoder placed before a segmentation model removes FGSM and I-FGSM perturbations, restoring up to 68% of the clean-image accuracy.
desk verdict A competent but non-adaptive defense evaluation; the 68% restoration only holds when the attacker ignores the denoiser. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the denoising autoencoder architecture: five convolutional encoder layers that halve resolution via strided convolutions, five deconvolutional decoder layers that double it, symmetric skip connections (excluding the first layer) to preserve spatial detail, ELU activations, and a sigmoid output. It is trained on PASCAL VOC images corrupted with Gaussian, Uniform, or Bimodal random noise, using both clean and noisy inputs so that clean-image performance is preserved. Placed in front of the unchanged segmentation model, it serves as a generic preprocessing defense whose noise-distribution choice modulates the trade-off between clean-image fidelity and adversarial robustness.
What would settle it
Generate a new adversarial image by computing the FGSM or I-FGSM perturbation with gradients backpropagated through the full composite of DAPAS followed by DeepLab V3 Plus, then measure the resulting mIoU. If the IoU drops to a level comparable to the undefended attack (around 13% of clean performance at epsilon 0.032), the central claim is falsified for adaptive adversaries.
Extended reading notes
Core claim
The central claim is that a denoising autoencoder (DAPAS) trained on random noise drawn from Gaussian, Uniform, or Bimodal distributions can act as a learned preprocessing filter that removes adversarial perturbations from images before they reach a semantic segmentation model. Using DeepLab V3 Plus as the victim model and PASCAL VOC 2012 as the dataset, the paper shows that after an FGSM or I-FGSM attack, passing the adversarial image through the autoencoder restores the mean Intersection over Union to about 68% of the clean baseline, while the unprotected model drops to about 13%. The clean-image cost is small, with an IoU reduction ratio of roughly 97% across all noise distributions. Because the autoencoder is trained on attack-agnostic random noise, the paper contends that it can defend against a variety of attacks without retraining the segmentation model.
Load-bearing premise
The defense is only tested against non-adaptive attacks, meaning the adversary creates the perturbation for the segmentation model alone and does not take the denoising autoencoder into account; if the attacker optimizes through both the autoencoder and the segmenter, the defense may not hold.
Editorial extensions
If this is right
- If the claim holds, any existing semantic segmentation model can be made more robust to gradient-based attacks without retraining, simply by prepending a trained denoising autoencoder.
- The approach is attack-agnostic in principle, because the autoencoder learns to remove generic noise rather than the specific perturbation pattern of a single attack.
- The clean-image cost is small enough (about 3% mIoU) that the defense could be deployed in practical pipelines such as autonomous driving perception.
- The same preprocessing idea could extend to image classification and object detection, since the autoencoder operates independently of the downstream task.
- The noise-distribution choice matters: bimodal noise, which matches the signed, fixed-magnitude structure of FGSM-style perturbations, gives the strongest attack recovery.
Reading between the lines
- The paper evaluates only non-adaptive attacks, where perturbations are computed against the segmentation model alone. If an attacker computes the adversarial perturbation through the full composite (autoencoder plus segmenter), the defense could collapse because gradients can be backpropagated through the autoencoder; future adversarial-training or stochastic-smoothing variants would be needed to
- The defense's effectiveness likely depends on the attack magnitude staying within the range of the noise distribution used in training; attacks with larger or more structured perturbations than the training noise may survive purification.
- The reported 68% recovery for I-FGSM might understate or overstate real-world robustness, since the paper uses a single step-count schedule and does not test targeted attacks or stronger iterative methods; a broader attack suite would map the operating envelope of the defense.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes DAPAS, a denoising autoencoder placed as a fixed preprocessor in front of a semantic segmentation model (DeepLab V3+). The DAE is trained on PASCAL VOC 2012 images corrupted by random noise drawn from one of three distributions (Gaussian, Uniform, Bimodal), and is then evaluated by generating FGSM and I-FGSM adversarial examples against DeepLab V3+ alone, passing them through the DAE, and measuring mIoU relative to the clean baseline. The paper reports roughly a 3% clean-image mIoU reduction and, for the strongest attack tested, restoration to about 68% of the original mIoU, and claims that the defense is attack-independent because the DAE is trained only on random noise.
Significance. If the reported results were obtained against a realistic adversary, DAPAS would be a useful, simple, model-agnostic preprocessing defense for semantic segmentation, with the practical advantage of not retraining the segmenter. The paper also addresses a relatively underexplored task, adversarial robustness of semantic segmentation, and compares three noise distributions. However, the central claim rests on a non-adaptive threat model: adversarial examples are computed against the bare segmenter and only then passed through the DAE. Because the DAE is a differentiable convolutional network, a standard adaptive attack can optimize the perturbation through both stages, and the known failure mode of preprocessing defenses directly applies. The paper's own evidence also shows that the training noise is tuned to the tested attack budget, so the claim of independence from adversarial attacks is not supported. With no adaptive evaluation, no comparison to other defenses, and no statistical repeatability, the main conclusion is not established.
major comments (4)
- [Section V-D and Section IV-C] The evaluation uses only adversarial examples generated against the original DeepLab V3+ model and then passed through DAPAS; no attack is computed against the composite system (DAE plus segmenter). Since the DAE is a deterministic, differentiable convolutional network, gradients of the segmentation loss can be backpropagated through both stages, so an I-FGSM/PGD attack can be run end-to-end. Preprocessing defenses of this kind are known to be bypassed by such adaptive attacks, and the abstract's unqualified claim that the attack 'can be protected' by a denoising autoencoder is therefore not supported by the experiments as designed.
- [Section IV-B and Section V] The noise distributions are explicitly chosen to match the attack perturbation budget: the Uniform range is [-0.035, 0.035] because the maximum tested perturbation is 0.032, and the Bimodal means are at ±0.024 with the same budget in mind. This makes the defense a tuned denoiser for the tested attack magnitudes rather than a generic, attack-independent preprocessor, and the statement in Section IV-C that the random noise is 'independent of any adversarial attack' is contradicted by these parameter choices.
- [Tables II-IV] All reported numbers are single mIoU values with no error bars, no multiple seeds, and no statistical significance tests. Given that the differences between the three noise distributions are often small (e.g., Table IV at epsilon=0.032 shows 53.3, 50.2, and 53.9), the claim that Bimodal is 'the best' is not established, and the absence of variance reporting makes the quantitative claims in the abstract (97% and 68%) unverifiable.
- [Section V-D and Tables III-IV] There is no comparison against even simple baselines such as JPEG compression, total-variance minimization, or adversarial training, and no comparison to previously proposed preprocessing defenses such as MagNet or Defense-GAN, which are cited in the related work. Without such comparisons, the reader cannot judge whether the reported restoration is a meaningful advance or simply a side effect of smoothing that would also occur with generic denoising.
minor comments (5)
- [Table IV] The last row of the Bimodal column reads '64.' with a missing digit; it should presumably be a value in the mid-60s consistent with the other columns.
- [Section III-A] The FGSM equations use the absolute value of the sign of the gradient, which is incorrect; the standard formulation uses the sign function itself, since taking the absolute value would always produce a positive perturbation.
- [Section III-B] The I-FGSM step-count formula 'min(epsilon + 2, 4 epsilon)' cannot be correct: for the epsilon values used in the experiments (e.g., 0.008) it returns 0.032, which is not an integer number of steps, and the expression mixes an epsilon in pixel units with an integer count.
- [Section V-B] The text refers to 'Fig. 11' and 'Fig. 4-(d)' for the noisy image after the denoise autoencoder, but the surrounding text and figure numbering suggest these should be consistent references to the same displayed result; the figure numbering in the manuscript appears scrambled.
- [Section V-D] The sentence 'When the epsilon is 0.008, 0.0016 and 0.0032' appears to contain typos; the table uses 0.001, 0.002, 0.004, 0.008, 0.016, and 0.032, so the text should be corrected to match the table.
Circularity Check
No significant circularity: DAPAS is an empirical defense evaluated against external FGSM/I-FGSM attacks; no prediction reduces to fitted input or self-citation.
full rationale
The paper contains no self-citation chain: all references to prior segmentation-attack results (e.g., [1]) are external. The central result—that a denoising autoencoder trained on synthetic Gaussian/Uniform/Bimodal noise restores mIoU after FGSM/I-FGSM attacks on DeepLab V3+—is an empirical measurement, not a derivation. The training noise parameters are chosen with the attack budget in mind (Uniform range -0.035 to 0.035 matches the max perturbation 0.032), but that is hyperparameter selection; the reported 68% robust IoU ratio is obtained by running real attacks and measuring mIoU, and the paper also reports the unprotected attack ratios (down to 13%), so the result is not forced by construction. The absence of adaptive attacks that differentiate through the DAE is an evaluation limitation, not a circularity: it concerns threat-model coverage, not equivalence of output to input. No equations in the paper reduce to their inputs, and no cited 'uniqueness' or prior-work claim is load-bearing. Therefore no circular step is established by the quoted text.
Assumptions & free parameters
free parameters (5)
- Gaussian noise standard deviation =
0.004
- Uniform noise range =
[-0.035, 0.035]
- Bimodal Gaussian means and standard deviation =
means -0.024 and 0.024; std 0.004
- I-FGSM step count formula and alpha =
step count min(epsilon+2, 4epsilon) or min(epsilon+4, 1.24epsilon); alpha=0.25
- DAE architecture hyperparameters =
5 conv / 5 deconv layers, ELU activation, skip connections, learning rate 5e-4
assumptions (3)
- domain assumption A denoising autoencoder trained on random noise generalizes to removing structured adversarial perturbations.
- domain assumption The adversarial attack is generated against the original segmentation model only, not against the full defense pipeline.
- domain assumption The PASCAL VOC validation set with SBD annotations is representative of general segmentation scenes.
Cite this review
Pith. "Pith review of DAPAS : Denoising Autoencoder to Prevent Adversarial attack in Semantic Segmentation." pith.science (2026). https://pith.science/paper/7CKEE3XS
@misc{pith2026190805195,
author = {Pith},
title = {Pith review of: DAPAS : Denoising Autoencoder to Prevent Adversarial attack in Semantic Segmentation},
year = {2026},
howpublished = {\url{https://pith.science/paper/7CKEE3XS}},
note = {Machine review of arXiv:1908.05195}
}
read the original abstract
Nowadays, Deep learning techniques show dramatic performance on computer vision area, and they even outperform human. But it is also vulnerable to some small perturbation called an adversarial attack. This is a problem combined with the safety of artificial intelligence, which has recently been studied a lot. These attacks have shown that they can fool models of image classification, semantic segmentation, and object detection. We point out this attack can be protected by denoise autoencoder, which is used for denoising the perturbation and restoring the original images. We experiment with various noise distributions and verify the effect of denoise autoencoder against adversarial attack in semantic segmentation.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
N. Carlini and D. Wagner. Towards evaluating the robustness of neural networks. In 2017 IEEE Symposium on Security and Privacy (SP) , pages 39–57. IEEE, 2017
work page 2017
-
[3]
L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE transactions on pattern analysis and machine intelligence , 40(4):834–848, 2017
2017
-
[4]
L.-C. Chen, Y . Zhu, G. Papandreou, F. Schroff, and H. Adam. Encoder- decoder with atrous separable convolution for semantic image segmen- tation. In Proceedings of the European conference on computer vision (ECCV), pages 801–818, 2018
work page 2018
- [5]
-
[6]
G. Elsayed, D. Krishnan, H. Mobahi, K. Regan, and S. Bengio. Large margin deep networks for classification. In Advances in neural infor- mation processing systems , pages 842–852, 2018
work page 2018
-
[7]
M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisser- man. The pascal visual object classes (voc) challenge. International journal of computer vision , 88(2):303–338, 2010
work page 2010
-
[8]
K. Eykholt, I. Evtimov, E. Fernandes, B. Li, A. Rahmati, C. Xiao, A. Prakash, T. Kohno, and D. Song. Robust physical-world attacks on deep learning visual classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 1625– 1634, 2018
work page 2018
Show all 30 references
-
[9]
Eykholt, I
K. Eykholt, I. Evtimov, E. Fernandes, B. Li, A. Rahmati, C. Xiao, A. Prakash, T. Kohno, and D. Song. Robust physical-world attacks on deep learning visual classification. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2018
2018
-
[10]
S. G. Finlayson, H. W. Chung, I. S. Kohane, and A. L. Beam. Ad- versarial attacks against medical deep learning systems. arXiv preprint 7 IJCNN 2020. International Joint Conference on Neural Networks. Glasgow, UK. 19-24 July 2020 arXiv:1804.05296, 2018
2020 arXiv
-
[11]
Goodfellow, J
I. Goodfellow, J. Shlens, and C. Szegedy. Explaining and harnessing adversarial examples. In International Conference on Learning Repre- sentations, 2015
2015
-
[12]
Hariharan, P
B. Hariharan, P. Arbel ´aez, L. Bourdev, S. Maji, and J. Malik. Semantic contours from inverse detectors. In 2011 International Conference on Computer Vision, pages 991–998. IEEE, 2011
2011
-
[13]
Kurakin, I
A. Kurakin, I. Goodfellow, and S. Bengio. Adversarial machine learning at scale. arXiv preprint arXiv:1611.01236 , 2016
2016 arXiv
-
[14]
Kurakin, I
A. Kurakin, I. Goodfellow, S. Bengio, Y . Dong, F. Liao, M. Liang, T. Pang, J. Zhu, X. Hu, C. Xie, et al. Adversarial attacks and defences competition. In The NIPS’17 Competition: Building Intelligent Systems , pages 195–231. Springer, 2018
2018
-
[15]
Meng and H
D. Meng and H. Chen. Magnet: a two-pronged defense against adversar- ial examples. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security , pages 135–147. ACM, 2017
2017
-
[16]
J. H. Metzen, M. C. Kumar, T. Brox, and V . Fischer. Universal adversarial perturbations against semantic image segmentation. In 2017 IEEE International Conference on Computer Vision (ICCV) , pages 2774–2783, Oct 2017
2017
-
[17]
Moosavi-Dezfooli, A
S.-M. Moosavi-Dezfooli, A. Fawzi, and P. Frossard. Deepfool: a simple and accurate method to fool deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 2574–2582, 2016
2016
-
[18]
Papernot, P
N. Papernot, P. McDaniel, and I. Goodfellow. Transferability in ma- chine learning: from phenomena to black-box attacks using adversarial samples. arXiv preprint arXiv:1605.07277 , 2016
2016 arXiv
-
[19]
Papernot, P
N. Papernot, P. McDaniel, I. Goodfellow, S. Jha, Z. B. Celik, and A. Swami. Practical black-box attacks against machine learning. In Proceedings of the 2017 ACM on Asia conference on computer and communications security , pages 506–519, 2017
2017
-
[20]
Papernot, P
N. Papernot, P. McDaniel, S. Jha, M. Fredrikson, Z. B. Celik, and A. Swami. The limitations of deep learning in adversarial settings. In 2016 IEEE European Symposium on Security and Privacy (EuroS&P) , pages 372–387. IEEE, 2016
2016
-
[21]
Papernot, P
N. Papernot, P. McDaniel, X. Wu, S. Jha, and A. Swami. Distillation as a defense to adversarial perturbations against deep neural networks. In 2016 IEEE Symposium on Security and Privacy (SP) , pages 582–597. IEEE, 2016
2016
-
[22]
Samangouei, M
P. Samangouei, M. Kabkab, and R. Chellappa. Defense-gan: Protecting classifiers against adversarial attacks using generative models. arXiv preprint arXiv:1805.06605, 2018
2018 arXiv
-
[23]
Sitawarin, A
C. Sitawarin, A. N. Bhagoji, A. Mosenia, M. Chiang, and P. Mittal. Darts: Deceiving autonomous cars with toxic signs. arXiv preprint arXiv:1802.06430, 2018
2018 arXiv
-
[24]
J. Su, D. V . Vargas, and K. Sakurai. One pixel attack for fooling deep neural networks. IEEE Transactions on Evolutionary Computation , 23(5):828–841, 2019
2019
-
[25]
Szegedy, W
C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations , 2014
2014
-
[26]
S. Thys, W. Van Ranst, and T. Goedem ´e. Fooling automated surveillance cameras: adversarial patches to attack person detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 0–0, 2019
2019
-
[27]
Tram `er, A
F. Tram `er, A. Kurakin, N. Papernot, I. Goodfellow, D. Boneh, and P. McDaniel. Ensemble adversarial training: Attacks and defenses. arXiv preprint arXiv:1705.07204, 2017
2017 arXiv
-
[28]
Vincent, H
P. Vincent, H. Larochelle, I. Lajoie, Y . Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research, 11(Dec):3371–3408, 2010
2010
-
[29]
C. Xie, J. Wang, Z. Zhang, Y . Zhou, L. Xie, and A. Yuille. Adversarial examples for semantic segmentation and object detection. In Proceed- ings of the IEEE International Conference on Computer Vision , pages 1369–1378, 2017
2017
-
[30]
H. Zhao, J. Shi, X. Qi, X. Wang, and J. Jia. Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 2881–2890, 2017. 8
2017
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.