REVIEW 5 major objections 7 minor 23 references
Infrared lights flashing on a moving object can make optical flow estimation networks output blank or chaotic flow, hiding the object from trackers in real time.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 11:29 UTC pith:UMFZO6XB
load-bearing objection The physical infrared attack setup is genuinely novel, but the printed L_Vis fitness is self-contradictory and the real-time claim is unmeasured; needs a careful rewrite before it can be trusted. the 5 major comments →
Physically Real-time Infrared Attack against Optical Flow Estimation Networks
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central discovery on the paper's own terms is that breaking the brightness constancy assumption — which optical flow estimation relies on — is sufficient to compromise modern deep OFENs in the physical world, and that a non-gradient evolutionary search can find effective infrared intensity patterns even though the physical light-conversion process is non-differentiable. The attack directly manipulates the physical scene rather than the input image, sidestepping the domain gap that weakens digital-to-physical adversarial examples. The paper's experiments show the attack works on two architectures and remains effective across a broad range of conditions.
What carries the argument
The pivotal mechanism is the temporal flashing of n infrared lights attached to the object, encoded as a perturbation vector P in [0,1]^n and rendered into the physical scene by a non-derivative conversion function C(·). Because C(·) defeats gradient-based optimization, the training phase uses a genetic algorithm with three fitness terms — invisibility (blanking the flow), imperceptibility (chaotic flow), and flash loss (inter-frame brightness difference) — and the attacking phase uses a trained single fully-connected layer (the AGN) to map the previous perturbation to the next in real time. The flash loss is the component that breaks brightness constancy.
Load-bearing premise
The load-bearing premise is that the genetic algorithm's fitness function correctly encodes the goal of blanking the optical flow; the paper's formula for the invisibility term appears to reward large flow instead, so everything depends on that being a typo.
What would settle it
Compute L_Vis for a truly blank flow (O ≈ 0): it is 0, not 1. Then run the GA with the fitness function exactly as written (maximize α·|O|/(HWC) + β·L_Per + L_Flash) and observe whether the optical flow becomes blank or larger. If flow magnitude rises, the claimed blanking effect is not produced by the stated objective.
If this is right
- If the claim holds, any downstream system that consumes optical flow (vehicle tracking, obstacle avoidance, behavior analysis) can be deceived without touching the victim model or its input feed.
- The reported success against both RAFT and PWC-Net suggests the attack is not tied to a single architecture, strengthening its threat model.
- Because the AGN is a single fully connected layer, the attack is fast enough for embedded deployment at camera frame rates.
- The ablation identifying flash loss as the most important term points to brightness constancy violation as the core vulnerability being exploited.
- The method's robustness across lighting, speed, and distance implies the physical conditioning problem that weakens many physical attacks is largely avoided.
Where Pith is reading between the lines
- The printed invisibility loss L_Vis = |O|/(H×W×C) is maximized when the optical flow magnitude is large, not blank; if this is not a transcription error, the GA would evolve perturbations that amplify flow, contradicting the paper's stated objective. This is our reading of the formula, not a claim the paper makes.
- The same physical mechanism should generalize to classical optical flow algorithms (e.g., Lucas–Kanade or block matching), since those also assume brightness constancy; a testable extension would be running the GA against such baselines.
- The two-stage GA-then-network pipeline could be accelerated by training the AGN on synthetic perturbations from a differentiable simulator, removing the need for a physical training track.
- Because cameras without infrared filters are the assumed target, the method may transfer to surveillance and traffic-camera environments that lack such filters.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes RILA, a physical-world attack against optical flow estimation networks (RAFT and PWC-Net) using infrared lights. An offline genetic algorithm (GA) optimizes light-intensity perturbation vectors in a physical testbed to maximize a fitness composed of three terms: invisibility, imperceptibility, and flash loss. The GA-generated perturbation pairs are then used to train a fully connected Adversarial Generative Network (AGN) that predicts the next perturbation from the previous one, enabling real-time deployment. Experiments in a physical environment with a moving plate report high Average Invisibility (AIV) and Average Imperceptibility (AIP) under varying ambient light, object speed, camera distance, and RAFT iteration count, and an ablation study examines the role of each loss term. The central claim is that the method reliably blinds or corrupts optical flow estimates in real time, making tracked objects effectively invisible to downstream tasks.
Significance. If the technical inconsistencies are resolved, the paper addresses a meaningful and underexplored problem: physical, real-time adversarial attacks on optical flow estimators, which are safety-critical upstream components in autonomous driving and surveillance. The use of infrared light as a stealthy physical perturbation channel is novel, and the physical deployment with GA-generated training data followed by a fast generative network is a sensible pipeline for circumventing the non-differentiability of physical light control. The paper includes physical experiments across several controlled conditions, which is a strength compared to purely digital attacks. However, the contribution is currently undermined by sign errors in the fitness definitions, missing metric formulas, and absent timing measurements, so the validity of the reported attack mechanism and the real-time claim cannot be assessed as written. No code is provided, and key hyperparameters are omitted, further limiting reproducibility.
major comments (5)
- [§4.2.2, Eq. (5)] The Invisibility loss is defined as L_Vis = |O_i|/(H×W×C), and the text states that when L_Vis tends to 1, the optical flow is blank. However, blank flow has |O_i|≈0, giving L_Vis≈0. Since the GA maximizes the fitness in Eq. (5), the printed objective selects for large flow magnitude, not blankness. This is not a minor typo: the same quantity appears to underlie the AIV metric in §5.1.3, so reported AIV values near 0.9 would then correspond to large flow magnitudes, contradicting the interpretation of 'invisibility.' Please correct the definition (e.g., L_Vis = 1 - |O_i|/(HWC)) or state clearly what the implemented fitness actually computes, and ensure the metric definitions are consistent with the claimed attack effect.
- [§5.2, Table 1] The ablation percentages reported in the text do not match Table 1. For RAFT, the relative AIV decrease when removing L_Vis is (0.900-0.887)/0.900 ≈ 1.4%, not 1.16%; the AIP decrease is (0.979-0.974)/0.979 ≈ 0.5%, not 0.26%. Similar discrepancies appear for N-Per and N-Flash (e.g., N-Flash AIV decrease is ≈3.4%, not 3.22%). The authors should recompute all percentages or correct the table, because the relative contribution of each loss is a central empirical claim.
- [§5 (overall, real-time claim)] The title and abstract claim 'real-time' attacks, and §4.1 states the attack must complete within one frame interval (about 30 ms). Yet no timing measurements are reported anywhere in §5. The latency of AGN inference, the hardware controller response, and the infrared light display time are never quantified. Without these numbers, the core real-time contribution of the paper is unsupported.
- [§5.3, baselines] The text says RILA is 'compared with Blank methods,' but no such baseline is defined or shown in the figures or tables. More importantly, there is no comparison against simpler physical attack strategies, such as fixed infrared intensities or a strobe pattern. The reported improvements over the original optical flow do not establish that the GA/AGN-optimized perturbations are what cause the attack; the mere presence of infrared light could provide the same effect. Adding such baselines is necessary to attribute the results to the proposed method.
- [§4.3, §5.1.1] The AGN is trained on GA-generated perturbation pairs collected on the same physical track used for evaluation, and all reported experiments are conducted on that same testbed. The paper claims robust performance 'across multiple scenarios,' but these scenarios (light levels, speeds, distances) are all within the same physical environment. No evidence is provided that the AGN or even the GA-generated perturbations transfer to different environments, camera placements, or object types. This limitation should be acknowledged explicitly, or cross-environment experiments should be added.
minor comments (7)
- [§5.3.1, Figure 7] Subfigure captions (a) and (b) are both labeled 'Without L_Vis'; they should be labeled 'AIV' and 'AIP' under varying ambient light.
- [Table 1] The table header 'Dis (cm)' appears to be copied from Table 3 and is not relevant to the ablation study.
- [§4.2.2] The definition of L_Per is ambiguous: it says '1 minus the average variance of each sliding window,' but does not specify whether the variance is computed on the optical flow field or on image intensities. Also, the text states that higher L_Per indicates flow is 'more chaos,' but 1 - variance is maximized by uniform (blank) flow, which is the opposite of chaos. Please clarify or correct.
- [§4.2 (GA hyperparameters)] The population size, number of generations, crossover probability, mutation rate, and tournament size are not reported. Without these, the GA-based training is not reproducible.
- [§4.3] The AGN architecture is described only as 'a fully connected layer.' The input/output dimensions, number of hidden units, activation functions, and training loss for the AGN are not provided. Please include these details.
- [Algorithm 1, line 4] The line 'P_i = GA(I_{i-1})' suggests the GA takes only the previous frame as input, but Eq. (2) requires both frames and both perturbations. Please clarify the actual inputs to the GA and whether the current frame is captured before or after the perturbation is applied.
- [§1] The claim that 'most cameras are usually not equipped with infrared filters' is stated without support and is questionable for consumer cameras, which commonly include IR-cut filters. Please justify or soften this statement.
Circularity Check
Partial circularity: the AGN is trained on GA-optimized perturbation pairs and evaluated on AIV/AIP metrics that mirror the GA fitness terms; the printed L_Vis definition also contradicts the claimed blank-flow mechanism.
specific steps
-
fitted input called prediction
[Section 4.2.2 (Eq. 5), Section 4.3 / Algorithm 1, Section 5.1.3]
"Invisibility (L_V is): This term is defined as L_V is = |O_i|/(H×W×C)... measures the invisibility of the perturbation. ... Given these three sub-fitness terms, the overall fitness function is ... F_itness(P_i)=α×L_V is+β×L_P er+L_F lash. ... Two performance metrics are computed to evaluate the performance of RILA: Average Invisibility (AIV) and Average Imperceptibility (AIP)."
The GA maximizes Eq. 5, whose leading term L_Vis is a mean-flow-magnitude quantity, and the reported success metric AIV is the same 'invisibility' construct. The AGN is trained on the GA-optimized pairs (P_{i-1}, P_i) and then evaluated with AIV/AIP, so the high attack-performance numbers partly restate the optimized objective by construction rather than an independent success measure. The physical deployment on new frames and varied conditions adds independent evidence, so the circularity is partial, not total.
-
self definitional
[Section 4.2.2 (Fitness Design)]
"When L_V istends to one, it indicates that the optical flow is blank, meaning no moving object will be detected."
By the paper's own definition, L_Vis = |O_i|/(H×W×C), so a blank optical flow (|O_i|≈0) gives L_Vis≈0, not 1. Maximizing L_Vis as written increases the mean flow magnitude, i.e., the opposite of 'blank'. The claimed fitness-to-effect link is inverted by the defining equation; if the implementation instead uses 1−L_Vis, the printed equation must be corrected. This is a self-definitional inconsistency in the central attack objective.
full rationale
The paper does not contain a formal derivation that reduces a prediction to its inputs, but it does contain two self-referential elements. First, the AGN is trained as a supervised imitator of the GA's optimized perturbations, and the main evaluation metrics AIV/AIP correspond to the same L_Vis/L_Per terms the GA fitness maximized; thus part of the reported attack performance is the optimized objective being re-measured. The physical testing across new frames, speeds, distances, and lighting provides genuine external evidence, so this is partial rather than fully forced. Second, the printed L_Vis formula contradicts its stated role: L_Vis = |O_i|/(HWC) is maximized by large flow magnitudes, whereas the text says L_Vis→1 means blank flow. This is a serious correctness risk and a self-definitional inconsistency, though it may be a typo for 1−|O_i|/(HWC). I flag it explicitly per the reviewing rule but do not treat it as intentional circularity. There is no load-bearing self-citation or imported uniqueness theorem.
Axiom & Free-Parameter Ledger
free parameters (4)
- γ (initialization bias) =
0.2 or 0.8 (depending on frame parity)
- α and β (loss weights) =
not reported
- GA hyperparameters (population, generations, crossover, mutation) =
not reported
- Sliding window size for L_Per =
not specified
axioms (4)
- domain assumption Brightness constancy is a valid assumption for the victim OFENs and attacking it disrupts estimation.
- domain assumption The victim camera is sensitive to 840nm infrared light and does not have an effective IR-cut filter.
- domain assumption The physical conversion C(·) from light intensity to image brightness is stable and repeatable across trials.
- ad hoc to paper The fully-connected AGN trained on GA-generated perturbation pairs generalizes to unseen time steps and motion states.
read the original abstract
With the promising performance of deep neural networks on image-based tasks, different real-world applications such as autonomous driving and motion detection have become increasingly mature and relevant to human lives. In particular, Optical Flow Estimation Networks (OFENs), as upstream models, play a critical role in different domains. Its outputs are heavily assumed and adopted for different downstream tasks, and it is essential to test its robustness to prevent safety accidents. We present an approach for real-time attacks on OFENs in the physical world, leveraging infrared lights for their stealthiness. By generating a large number of Adversarial Examples in advance, our approach computes AEs in real time and dynamically displays them, which allows our method to facilitate precise and targeted attacks without modifying the victim system. Unlike previous digital-to-physical attack techniques, our method directly attacks victim models within the physical world, thereby overcoming the limitations associated with the ineffectiveness of AEs. Experimental results demonstrate the efficacy of our approach in compromising OFENs across diverse lighting conditions, varying object motion velocities, and different object placements, ultimately impairing the network's ability to accurately estimate optical flow.
Figures
Reference graph
Works this paper leans on
-
[1]
On the vulnerability of traffic light recognition systems to laser illumination attacks
Sri Hrushikesh Varma Bhupathiraju, Takeshi Sugawara, Takami Sato, Qi Alfred Chen, Michael Clifford, and Sara Rampazzi. On the vulnerability of traffic light recognition systems to laser illumination attacks. InISOC Symposium on Vehicle Security and Privacy (VehicleSec). ISOC, San Diego, CA, USA. https://doi. org/10, 2024. 2
2024
-
[2]
Adversarial patch.arXiv preprint arXiv:1712.09665, 2017
Tom B Brown, Dandelion Man ´e, Aurko Roy, Mart´ın Abadi, and Justin Gilmer. Adversarial patch.arXiv preprint arXiv:1712.09665, 2017. 2
Pith/arXiv arXiv 2017
-
[3]
Optical flow based visual potential field for autonomous driving
Linda Capito, Umit Ozguner, and Keith Redmill. Optical flow based visual potential field for autonomous driving. In 2020 IEEE Intelligent Vehicles Symposium (IV), pages 885–
2020
-
[4]
Jes ´us Chamorro-Martinez and Joaqu ´ın Fern ´andez-Valdivia. A new approach to motion pattern recognition and its ap- plication to optical flow estimation.IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(1):39–51, 2006. 1
2006
-
[5]
Sparse and imperceiv- able adversarial attacks
Francesco Croce and Matthias Hein. Sparse and imperceiv- able adversarial attacks. InProceedings of the IEEE/CVF international conference on computer vision, pages 4724– 4732, 2019. 2
2019
-
[6]
Flownet: Learning optical flow with convolutional networks
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, and Thomas Brox. Flownet: Learning optical flow with convolutional networks. InPro- ceedings of the IEEE international conference on computer vision, pages 2758–2766, 2015. 2
2015
-
[7]
Adversarial laser beam: Effective physical-world attack to dnns in a blink
Ranjie Duan, Xiaofeng Mao, A Kai Qin, Yuefeng Chen, Shaokai Ye, Yuan He, and Yun Yang. Adversarial laser beam: Effective physical-world attack to dnns in a blink. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 16062–16071, 2021. 2
2021
-
[8]
Robust physical-world attacks on deep learning visual classification
Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li, Amir Rahmati, Chaowei Xiao, Atul Prakash, Tadayoshi Kohno, and Dawn Song. Robust physical-world attacks on deep learning visual classification. InProceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 1625–1634, 2018. 2
2018
-
[9]
Optical adversarial attack
Abhiram Gnanasambandam, Alex M Sherman, and Stan- ley H Chan. Optical adversarial attack. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 92–101, 2021. 3
2021
-
[10]
Invisible optical adversarial stripes on traffic sign against autonomous vehicles
Dongfang Guo, Yuting Wu, Yimin Dai, Pengfei Zhou, Xin Lou, and Rui Tan. Invisible optical adversarial stripes on traffic sign against autonomous vehicles. InProceedings of the 22nd Annual International Conference on Mobile Sys- tems, Applications and Services, pages 534–546, 2024. 2, 3
2024
-
[11]
Combination of edge element and optical flow estimates for 3d-model-based vehicle tracking in traffic image sequences.International Journal of Computer Vision, 35:295–319, 1999
Michael Haag and Hans-Hellmut Nagel. Combination of edge element and optical flow estimates for 3d-model-based vehicle tracking in traffic image sequences.International Journal of Computer Vision, 35:295–319, 1999. 1
1999
-
[12]
Yu-Chih-Tuan Hu and et al. Kung. Naturalistic physical ad- versarial patch for object detectors. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 7848–7857, 2021. 2
2021
-
[13]
On physical adversarial patches for object detection.arXiv preprint arXiv:1906.11897, 2019
Mark Lee and Zico Kolter. On physical adversarial patches for object detection.arXiv preprint arXiv:1906.11897, 2019. 2
Pith/arXiv arXiv 1906
-
[14]
Perceptual-sensitive gan for generating adversarial patches
Aishan Liu, Xianglong Liu, Jiaxin Fan, Yuqing Ma, Anlan Zhang, Huiyuan Xie, and Dacheng Tao. Perceptual-sensitive gan for generating adversarial patches. InProceedings of the AAAI conference on artificial intelligence, pages 1028–1035,
-
[15]
Simple black-box adversarial attacks on deep neural networks
Nina Narodytska and Shiva Prasad Kasiviswanathan. Simple black-box adversarial attacks on deep neural networks. In CVPR Workshops, 2017. 2
2017
-
[16]
Attacking optical flow
Anurag Ranjan, Joel Janai, Andreas Geiger, and Michael J Black. Attacking optical flow. InProceedings of the IEEE/CVF international conference on computer vision, pages 2404–2413, 2019. 2
2019
-
[17]
Sayanan Sivaraman and Mohan Manubhai Trivedi. Look- ing at vehicles on the road: A survey of vision-based vehi- cle detection, tracking, and behavior analysis.IEEE trans- actions on intelligent transportation systems, 14(4):1773– 1795, 2013. 1
2013
-
[18]
Fast optical flow es- timation and its application to real-time obstacle avoidance
Kai-Tai Song and Jui-Hsiang Huang. Fast optical flow es- timation and its application to real-time obstacle avoidance. InProceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No. 01CH37164), pages 2891–2896. IEEE, 2001. 1
2001
-
[19]
Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume
Deqing Sun, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 8934–8943,
-
[20]
Raft: Recurrent all-pairs field transforms for optical flow
Zachary Teed and Jia Deng. Raft: Recurrent all-pairs field transforms for optical flow. InComputer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23– 28, 2020, Proceedings, Part II 16, pages 402–419. Springer,
2020
-
[21]
Rfla: A stealthy reflected light adversarial at- tack in the physical world
Donghua Wang, Wen Yao, Tingsong Jiang, Chao Li, and Xi- aoqian Chen. Rfla: A stealthy reflected light adversarial at- tack in the physical world. InProceedings of the IEEE/CVF international conference on computer vision, pages 4455– 4465, 2023. 2
2023
-
[22]
I can see the light: Attacks on autonomous vehicles using invisible lights
Wei Wang, Yao Yao, Xin Liu, Xiang Li, Pei Hao, and Ting Zhu. I can see the light: Attacks on autonomous vehicles using invisible lights. InProceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Se- curity, pages 1930–1944, 2021. 2
2021
-
[23]
Robust physical-world attacks on face recognition.Pattern Recognition, 133:109009, 2023
Xin Zheng, Yanbo Fan, Baoyuan Wu, Yong Zhang, Jue Wang, and Shirui Pan. Robust physical-world attacks on face recognition.Pattern Recognition, 133:109009, 2023. 2
2023
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.