REVIEW 2 major objections 3 minor 3 cited by
Evaluating the Robustness of the "Ensemble Everything Everywhere" Defense
T0 review · 2 major / 3 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read The 'Ensemble Everything Everywhere' defense is not robust to adversarial attack: adaptive attacks reduce its robust accuracy from 62% to 11% on CIFAR-10 and from 48% to 14% on CIFAR-100 under $\ell_\infty$ perturbations of $8/255$.
desk verdict Strong adaptive attack with disclosed bug fix convincingly breaks the released E3 implementation; the only real caveat is that the exact original models were not attacked, but the limitation is disclosed and the core diagnosis holds. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central objects are the defense's CrossMax aggregation (normalize each layer's logits, then each class, then take the $k$-th highest score across layers) and its random multi-resolution preprocessing; together they create a spiky loss landscape that masks gradients. The attack's load-bearing mechanism is expectation over transformation: averaging gradients over many random preprocessings, combined with transfer from the mean-aggregation variant, bypasses the masking and lets standard PGD and APGD find adversarial examples.
What would settle it
Train the original defense exactly as described (larger models, longer training, with adversarial training) and run this paper's adaptive attack under the same $\ell_\infty$ threat model; if the adversarial training version keeps robust accuracy near the claimed 48% (CIFAR-100) or 62% (CIFAR-10), the paper's conclusion that the defense is not robust would be falsified for that version.
Extended reading notes
Core claim
The paper claims that the defense's published robustness numbers are overclaimed. Using the officially released training code, the authors reproduce clean accuracies of 88.9% (CIFAR-10) and 64.1% (CIFAR-100) and AutoAttack robust accuracies consistent with the original reports (61.8% and 47.9%). They then build an adaptive attack that first reveals gradient masking in the loss landscape, then attacks a mean-aggregation variant of the model and transfers the resulting adversarial examples to the full defense while averaging gradients over many random preprocessings (expectation over transformation). With further tricks—more steps, a larger initial radius, and a hinge loss—the attack drives robust accuracy down to 11.3% on CIFAR-10 and 13.8% on CIFAR-100.
Load-bearing premise
The attack targets models trained from the official released code, not the exact models used in the original defense paper (which trained larger models for longer and optionally with adversarial training), so the conclusion depends on these public-code models faithfully representing the defense.
Editorial extensions
If this is right
- AutoAttack alone is not a sufficient evaluation for defenses with random preprocessing and non-smooth aggregation; adaptive attacks that account for the randomness are needed.
- The defense does not provide a fourth, non-adversarial-training approach to high robustness, contrary to its initial claim.
- Perceptually aligned gradients do not imply adversarial robustness; interpretable perturbations can coexist with severe gradient masking.
- Existing evaluation techniques—unit tests, loss landscape visualization, and expectation over transformation—suffice to break this defense, reinforcing the need for rigorous adaptive evaluation before claiming robustness.
Reading between the lines
- Because the authors evaluated models from the official code without the original paper's larger networks, longer training, or optional adversarial training, the result does not strictly rule out that the adversarially trained version is more robust; the evidence refutes the claim for the standard version released in the official repository.
- The failure mode suggests that other defenses combining random input transformations with piecewise-constant aggregation functions may hide similar gradient masking, so future evaluations should include a 'remove the non-smooth component and transfer' baseline before making robustness claims.
- The multi-resolution representation itself may still be useful for interpretability and image manipulation, independent of worst-case robustness.
- A testable extension: run the same adaptive attack on the original authors' exact models if they are released; if robust accuracy remains near the claimed 48% (CIFAR-100) or 62% (CIFAR-10), the overclaim would be confined to the re-implementation rather than the defense idea.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This short note evaluates the robustness of the 'Ensemble Everything Everywhere' defense [11] under an l_infinity threat model with epsilon = 8/255. The authors retrain the official implementation on CIFAR-10 and CIFAR-100, demonstrate severe gradient masking via loss-landscape plots and unit tests, and then apply adaptive attacks (PGD with EoT, transfer from a mean-aggregation surrogate, and APGD with a larger initial radius) to reduce robust accuracy from 61.8% to 10.9% on CIFAR-10 and from 47.9% to 13.6% on CIFAR-100. They conclude that the defense is not robust and that its earlier evaluation was inadequate. The report also discloses and corrects a bug in an earlier version of the attack, and uses a separate verification script to ensure final perturbations respect the epsilon bound.
Significance. If the result holds, this is a valuable negative result for a high-profile defense and a useful case study in the adaptive evaluation of stochastic defenses. The paper's strengths include the careful attack construction: it discloses the earlier implementation bug, uses a standalone verification script, reports ablations for the number of EoT iterations, and applies existing unit tests for detecting weak evaluations. The main limitation is that the attacks are run on models retrained from the official code rather than on the exact models from the original defense paper, and the paper acknowledges that the original models were larger, trained longer, and sometimes adversarially trained. Consequently, the blanket conclusion that 'the defense is not robust' is stronger than what the evidence directly establishes.
major comments (2)
- [Section 4 (Setup) and Abstract] The paper's headline claim that the defense 'is not robust' is broader than the evidence. The models attacked in Table 1 are retrained from the official code, not the exact models from [11]; the paper itself states that 'the paper [11] reports slightly higher robustness numbers using larger models, longer training runs, and combining with adversarial training' and that those models and training code are not publicly released. Thus the attack directly shows only that the reproduced official implementation is vulnerable, not that the defense as originally claimed is not robust. The abstract and conclusion should either be scoped to 'the public implementation' or 'the reproduced model,' or the authors should provide evidence that the reproduction is representative of the original defense (e.g., by comparing clean and robust accuracy profiles on the same protocol).
- [Section 4, Table 1] The quantitative reductions quoted in the abstract (e.g., 'from 62% to 11%') are measured on only 100 test samples, and the paper does not describe how these samples were selected. The large gap between the achieved robust accuracy and the AutoAttack baseline is sufficient for a qualitative refutation, but the exact figures should be reported with a confidence interval or the evaluation should be run on a larger random subset of the test set so that the numerical claims are not overstated.
minor comments (3)
- [Abstract and Section 1] There is a typo in the abstract ('this defense' robustness' should be 'this defense's robustness') and in Section 1 'the notably exception' should be 'the notable exception.'
- [Section 3.2] The unit test description omits the number of unit-test models and the exact pass criterion, so a reader cannot tell whether a 'unit test pass rate of 60%' refers to the fraction of models on which the attack succeeded or the fraction of samples. Please clarify and refer to the exact protocol in [36].
- [References] Reference [34] is missing the full author list ('W Xu' should be 'Weilin Xu, David Evans, and Yanjun Qi').
Circularity Check
No circularity: the robustness evaluation is an empirical measurement, not a derivation from the paper's own claims.
full rationale
This paper makes no predictive claim and fits no parameters to a target outcome; its central numbers are direct empirical measurements of attack success on models trained from the defense's official code. The reported robust-accuracy drops (61.8% to 11.3% on CIFAR-10, 47.9% to 13.8% on CIFAR-100) are results of running adaptive attacks, not quantities implied by construction from the paper's assumptions. The methodology it cites—Expectation over Transformation, AutoAttack, adaptive-attack guidelines, and unit tests for evaluating defenses—is external, established work and is used as a toolkit rather than as a premise that contains the conclusion. The authors' own prior publications appear only as standard methodological references, not as load-bearing self-citations invoked to force a result. The disclosed limitation that the original defense's exact trained models were not released, so the authors attack retrained models from official code, is a scope caveat about representativeness, not a circular step: the attack does not assume the defense is broken in order to show it is broken. No equation, definition, or citation chain equates the output to an input. Therefore the derivation chain is self-contained and no significant circularity is present.
Assumptions & free parameters
free parameters (3)
- PGD steps =
400-1000
- EoT iterations =
100
- APGD initial radius schedule =
3 epsilon, then 2 epsilon, then epsilon
assumptions (3)
- domain assumption The officially released training code faithfully implements the E3 defense as described in [11].
- domain assumption Robust accuracy measured on 100 test samples is representative of the defense's robustness.
- standard math Standard adaptive attack techniques (EoT, transfer learning from a simplified model, APGD) are valid evaluations for a randomized defense.
Cite this review
Pith. "Pith review of Evaluating the Robustness of the "Ensemble Everything Everywhere" Defense." pith.science (2026). https://pith.science/paper/3QKOZD7S
@misc{pith2026241114834,
author = {Pith},
title = {Pith review of: Evaluating the Robustness of the "Ensemble Everything Everywhere" Defense},
year = {2026},
howpublished = {\url{https://pith.science/paper/3QKOZD7S}},
note = {Machine review of arXiv:2411.14834}
}
abstract
Ensemble everything everywhere is a defense to adversarial examples that was recently proposed to make image classifiers robust. This defense works by ensembling a model's intermediate representations at multiple noisy image resolutions, producing a single robust classification. This defense was shown to be effective against multiple state-of-the-art attacks. Perhaps even more convincingly, it was shown that the model's gradients are perceptually aligned: attacks against the model produce noise that perceptually resembles the targeted class. In this short note, we show that this defense is not robust to adversarial attack. We first show that the defense's randomness and ensembling method cause severe gradient masking. We then use standard adaptive attack techniques to reduce the defense's robust accuracy from 48% to 14% on CIFAR-100 and from 62% to 11% on CIFAR-10, under the $\ell_\infty$-norm threat model with $\varepsilon=8/255$.
Figures
Forward citations
Cited by 3 Pith papers
-
Obfuscated Activations Bypass LLM Latent-Space Defenses
Obfuscation attacks that jointly optimize for target behavior and for low monitor scores bypass sparse autoencoders, probes, and OOD detectors on LLMs, while performance degrades mainly on hard tasks like writing correct SQL.
-
Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
ML conferences should create an official peer-reviewed track dedicated to refuting and critiquing previously published work.
-
A Note on Implementation Errors in Recent Adaptive Attacks Against Multi-Resolution Self-Ensembles
An implementation bug in Zhang et al.'s adaptive attack accumulated L-infinity perturbations up to 160/255, and with correct 8/255 bounds the multi-resolution self-ensemble defense retains non-trivial robustness.
Reference graph
Works this paper leans on
-
[11]
Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness, 2024
Stanislav Fort and Balaji Lakshminarayanan. Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness, 2024
work page 2024
-
[1]
Robustness to Adversarial Examples through an Ensemble of Specialists
Mahdieh Abbasi and Christian Gagn´ e. Robustness to adversarial examples through an ensemble of specialists. arXiv preprint arXiv:1702.06856 , 2017
work page Pith review arXiv 2017
-
[2]
Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Anish Athalye, Nicholas Carlini, and David Wagner. Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples. In International conference on machine learning, pages 274–283. PMLR, 2018
2018
-
[3]
Evasion attacks against machine learning at test time
Battista Biggio, Igino Corona, Davide Maiorca, Blaine Nelson, Nedim ˇSrndi´ c, Pavel Laskov, Giorgio Giacinto, and Fabio Roli. Evasion attacks against machine learning at test time. In European Conference on Machine Learning and Knowledge Discovery in Databases, pages 387–402. Springer, 2013
work page 2013
-
[4]
Comment on "Biologically inspired protection of deep networks from adversarial attacks"
Wieland Brendel and Matthias Bethge. Comment on ”biologically inspired protection of deep networks from adversarial attacks”. arXiv preprint arXiv:1704.01547 , 2017
work page Pith review arXiv 2017
-
[5]
Defensive distillation is not robust to adversarial examples
Nicholas Carlini and David Wagner. Defensive distillation is not robust to adversarial examples. arXiv preprint arXiv:1607.04311 , 2016
arXiv 2016
-
[6]
Towards evaluating the robustness of neural networks
Nicholas Carlini and David Wagner. Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (sp) , pages 39–57. Ieee, 2017
2017
-
[7]
Certified adversarial robustness via randomized smoothing
Jeremy Cohen, Elan Rosenfeld, and Zico Kolter. Certified adversarial robustness via randomized smoothing. In International Conference on Machine Learning , pages 1310–1320, 2019
work page 2019
Show all 36 references
-
[8]
Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks
Francesco Croce and Matthias Hein. Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. In International conference on machine learning , pages 2206–2216. PMLR, 2020
2020
-
[9]
Mind the box: l 1-apgd for sparse adversarial attacks on image classifiers
Francesco Croce and Matthias Hein. Mind the box: l 1-apgd for sparse adversarial attacks on image classifiers. In ICML, 2021
2021
-
[10]
A note on implementation errors in recent adaptive attacks against multi-resolution self-ensembles, 2025
Stanislav Fort. A note on implementation errors in recent adaptive attacks against multi-resolution self-ensembles, 2025
2025
-
[12]
Do perceptually aligned gradients imply adversarial robustness? arXiv preprint arXiv:2207.11378 , 2022
Roy Ganz, Bahjat Kawar, and Michael Elad. Do perceptually aligned gradients imply adversarial robustness? arXiv preprint arXiv:2207.11378 , 2022
2022 arXiv
-
[13]
Ai2: Safety and robustness certification of neural networks with abstract interpretation
Timon Gehr, Matthew Mirman, Dana Drachsler-Cohen, Petar Tsankov, Swarat Chaudhuri, and Martin Vechev. Ai2: Safety and robustness certification of neural networks with abstract interpretation. In IEEE Symposium on Security and Privacy , 2018
2018
-
[14]
Countering adversarial images using input transformations
Chuan Guo, Mayank Rana, Moustapha Cisse, and Laurens Van Der Maaten. Countering adversarial images using input transformations. arXiv preprint arXiv:1711.00117 , 2017
2017 arXiv
-
[15]
Certified robustness to adversarial examples with differential privacy
Mathias Lecuyer, Vaggelis Atlidakis, Roxana Geambasu, Daniel Hsu, and Suman Jana. Certified robustness to adversarial examples with differential privacy. In IEEE Symposium on Security and Privacy , pages 656–672, 2019. 8
2019
-
[16]
Towards better adversarial purification via adversarial denoising diffusion training
Yiming Liu, Kezhao Liu, Yao Xiao, Ziyi Dong, Xiaogang Xu, Pengxu Wei, and Liang Lin. Towards better adversarial purification via adversarial denoising diffusion training. arXiv preprint arXiv:2404.14309, 2024
2024 arXiv
-
[17]
Foveation-based mechanisms alleviate adversarial examples
Yan Luo, Xavier Boix, Gemma Roig, Tomaso Poggio, and Qi Zhao. Foveation-based mechanisms alleviate adversarial examples. arXiv preprint arXiv:1511.06292 , 2015
2015 arXiv
-
[18]
Towards deep learning models resistant to adversarial attacks
Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. Towards deep learning models resistant to adversarial attacks. In International Conference on Learning Representations, 2018
2018
-
[19]
On detecting adversarial perturbations
Jan Hendrik Metzen, Tim Genewein, Volker Fischer, and Bastian Bischoff. On detecting adversarial perturbations. arXiv preprint arXiv:1702.04267 , 2017
2017 arXiv
-
[20]
Biologically inspired protection of deep networks from adversarial attacks
Aran Nayebi and Surya Ganguli. Biologically inspired protection of deep networks from adversarial attacks. arXiv preprint arXiv:1703.09202 , 2017
2017 arXiv
-
[21]
Improving adversarial robustness via promoting ensemble diversity
Tianyu Pang, Kun Xu, Chao Du, Ning Chen, and Jun Zhu. Improving adversarial robustness via promoting ensemble diversity. In International Conference on Machine Learning, pages 4970–4979. PMLR, 2019
2019
-
[22]
Practical black-box attacks against machine learning
Nicolas Papernot, Patrick McDaniel, Ian Goodfellow, Somesh Jha, Z Berkay Celik, and Ananthram Swami. Practical black-box attacks against machine learning. In ACM Asia Conference on Computer and Communications Security , pages 506–519, 2017
2017
-
[23]
Barrage of random transforms for adversarially robust defense
Edward Raff, Jared Sylvester, Steven Forsyth, and Mark McLean. Barrage of random transforms for adversarially robust defense. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 6528–6537, 2019
2019
-
[24]
Certified defenses against adversarial examples
Aditi Raghunathan, Jacob Steinhardt, and Percy Liang. Certified defenses against adversarial examples. In International Conference on Learning Representations , 2018
2018
-
[25]
Adversarial manipulation of deep representations
Sara Sabour, Yanshuai Cao, Fartash Faghri, and David J Fleet. Adversarial manipulation of deep representations. arXiv preprint arXiv:1511.05122 , 2015
2015 arXiv
-
[26]
Public comment: Robustness eval- uation seems invalid
Christian Schlarmann, Francesco Croce, and Matthias Hein. Public comment: Robustness eval- uation seems invalid. https://openreview.net/forum?id=IHRQif8VQC¬eId=vUzo8RWZeM, 2024
2024
-
[27]
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfel- low, and Rob Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations, 2014
2014
-
[28]
On adaptive attacks to adversarial example defenses
Florian Tramer, Nicholas Carlini, Wieland Brendel, and Aleksander Madry. On adaptive attacks to adversarial example defenses. Advances in neural information processing systems, 33:1633–1645, 2020
2020
-
[29]
Ensemble adversarial training: Attacks and defenses
Florian Tram` er, Alexey Kurakin, Nicolas Papernot, Ian Goodfellow, Dan Boneh, and Patrick McDaniel. Ensemble adversarial training: Attacks and defenses. In International Conference on Learning Representations, 2018
2018
-
[30]
Robustness may be at odds with accuracy
Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, and Aleksander Madry. Robustness may be at odds with accuracy. arXiv preprint arXiv:1805.12152 , 2018
2018 arXiv
-
[31]
Provable defenses against adversarial examples via the convex outer adversarial polytope
Eric Wong and Zico Kolter. Provable defenses against adversarial examples via the convex outer adversarial polytope. In International conference on machine learning , pages 5286–5295. PMLR, 2018
2018
-
[32]
Fast is better than free: Revisiting adversarial training
Eric Wong, Leslie Rice, and J Zico Kolter. Fast is better than free: Revisiting adversarial training. arXiv preprint arXiv:2001.03994 , 2020
2001 arXiv
-
[33]
Mitigating adversarial effects through randomization
Cihang Xie, Jianyu Wang, Zhishuai Zhang, Zhou Ren, and Alan Yuille. Mitigating adversarial effects through randomization. arXiv preprint arXiv:1711.01991 , 2017. 9
2017 arXiv
-
[34]
Feature squeezing: Detecting adversarial examples in deep neural networks
W Xu. Feature squeezing: Detecting adversarial examples in deep neural networks. arXiv preprint arXiv:1704.01155, 2017
2017 arXiv
-
[35]
ME-Net: Towards effective adversarial robustness with matrix estimation
Yuzhe Yang, Guo Zhang, Dina Katabi, and Zhi Xu. ME-Net: Towards effective adversarial robustness with matrix estimation. arXiv preprint arXiv:1905.11971 , 2019
1905 arXiv
-
[36]
Increasing confidence in adversarial robustness evaluations
Roland S Zimmermann, Wieland Brendel, Florian Tramer, and Nicholas Carlini. Increasing confidence in adversarial robustness evaluations. Advances in neural information processing systems, 35:13174–13189, 2022. 10
2022
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.