REVIEW 3 major objections 5 minor 32 references
FressDet, a C4-rotation-equivariant detector that treats spectral bands as a continuous ordered axis, matches or beats much larger multispectral detectors on five benchmarks while using 93% fewer parameters.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-02 08:27 UTC pith:5I33ZNUZ
load-bearing objection A useful, well-engineered multispectral detector with honest supplementary proofs, but the 'fully equivariant' label runs ahead of the rectangular input sizes used in most benchmarks. the 3 major comments →
Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central discovery claimed is that full C4 rotation equivariance can be combined with continuous, order-preserving spectral resampling in a single-stream detector without parameter replication, and that this combination yields state-of-the-art accuracy at a fraction of the parameter count of prior work. SpeIW converts the discrete band axis into a coordinate-conditioned implicit field whose positive increments are cumulatively summed, guaranteeing that spectral channel order is preserved under resampling. ReCoW adaptively gates spectral and spatial cues by their rotation-invariant agreement, and the oriented-aware head reads out class, box, and angle predictions from group-indexed feature
What carries the argument
The load-bearing object is the C4 regular representation carried by every feature map: a 90-degree input rotation becomes a cyclic permutation of the orientation axis plus a spatial rotation, and each module is built to commute with that action. SpeIW builds a continuous spectral warp: Fourier-encoded spectral coordinates feed a shared MLP that outputs basis vectors, inner products with a spatial latent code give per-pixel offsets, and softplus-plus-cumulative-sum forces strictly increasing resampling indices. ReCoW routes two prototypes (soft spectral, hard spatial) and weights a residual update by their group-averaged cosine agreement; the oriented head uses group-pooled classification and
Load-bearing premise
The proof that every component is C4-equivariant requires feature lattices and ReCoW window partitions that map to themselves under 90-degree rotation, which holds for square grids; several reported benchmarks use rectangular input sizes and the paper does not describe a square-cropping or padding step, so if that condition is not met in the implementation, the 'fully rotation-equivariant' guarantee does not apply to those experiments.
What would settle it
Take a MODA image at its native 1216x928 resolution, rotate it by exactly 90 degrees, and measure the normalized equivariance error (Eq. 2 in the supplement) at each backbone stage under the released code. If the error is orders of magnitude above floating-point round-off, or if rotating the input by 90 degrees does not produce a correspondingly rotated output feature map, the full-equivariance claim fails for the reported setting; the same check with square-padded inputs would isolate whether the lattice condition is the culprit.
If this is right
- SpeIW's shared implicit field can be queried at any spectral coordinate, so the same warp machinery applies to inputs with different or variable numbers of bands without scaling parameter count with band count.
- On MODA, FressDet raises mAP50 from 69.0 (OSSDet) to 73.1 while shrinking parameters from 36.6M to 2.3M and FLOPs from 263G to 31.7G; the largest gains are on small classes (bike +16.7, pedestrian +26.8 mAP50).
- Replacing the spectral operator with four deformable-convolution variants drops mAP by 1.1 to 1.5 points, supporting the claim that the order-preserving continuous warp, not equivariance alone, carries part of the gain.
- Trained from scratch without rotation augmentation, FressDet keeps lower equivariance error than a non-equivariant baseline at every backbone stage and degrades less than competitors under 1-degree-step rotations of MODA.
- The SpeIWNet backbone transfers to five existing detectors, each gaining accuracy while shrinking parameter count, so the contribution is not tied to one head design.
Where Pith is reading between the lines
- Because the spectral warp is coordinate-conditioned and the coefficients are pixel-conditioned, the same field could be reused at inference on images with different spectral calibration or band order; a test would be zero-shot evaluation on a dataset with a different band set.
- The rectangular-input gap between the square-lattice proof and the MODA, HOD3K, and LLVIP resolutions suggests a concrete fix—symmetric zero-padding to a square before the lifting layer—and a measurable prediction: after that fix, exact 90-degree equivariance error on those datasets should drop to floating-point level.
- The 93% parameter reduction implies that much of the capacity in conventional detectors is spent memorizing rotated variants of features; if so, similar compression ratios should appear when this architecture is applied to other rotation-heavy dense tasks, such as aerial segmentation.
- ReCoW's soft/hard routing asymmetry is a design principle that could generalize beyond multispectral fusion: use soft assignment where cues mix continuously, hard assignment where boundaries matter.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces FressDet, a C4-equivariant single-stream multispectral object detector. Its three components are: SpeIW, an implicit spectral warp that resamples the channel/spectral axis with a monotone order-preserving map; ReCoW, a reliability-aware fusion module that combines spectral and spatial routing through an agreement-weighted residual gate; and an oriented-aware head that uses group-indexed features to predict oriented boxes. Experiments on MODA, HOD3K, DroneVehicle and, in the supplement, LLVIP and VEDAI report state-of-the-art mAP with a 2.3M-parameter model. The supplement provides conditional equivariance proofs with explicit caveats about numerical precision, lattice conditions, unique routing, and angle-branch degeneracy.
Significance. If the claims hold, the result is significant: it unifies continuous spectral modeling with group-equivariant detection and shows that a compact equivariant model with 2.3M parameters can match or exceed much larger baselines on several multispectral benchmarks. The manuscript's strengths are its unusually candid supplement — acknowledging that full equivariance is algebraic and conditional on stated compatibility assumptions — the released code, the controlled RE-DCN spectral-operator ablation, and the cross-detector backbone transfer experiments. The main unresolved issue is that the stated proof conditions are not met by three of the five reported evaluation settings, so the central 'fully rotation-equivariant' claim is not established for the headline experiments as described.
major comments (3)
- [Supp. S1.2/S3.4 vs S5.3] The end-to-end C4-equivariance proof is conditional on feature lattices and ReCoW window partitions being invariant under 90 degree rotations; S1.2 explicitly reasons about square feature grids with symmetric constant padding, and S3.4 lists lattice compatibility as condition (i). However, S5.3 reports rectangular training inputs for MODA (1216x928), HOD3K (1024x512), and LLVIP (1280x1024), and no square-crop or square-pad step is described in the main text or supplement. A 90 degree rotation of a 1216x928 tensor yields a 928x1216 tensor, so the input domain is not closed under the claimed group action. The main 'fully rotation-equivariant' statement therefore does not cover three of the five benchmarks, including the headline MODA result. The paper must either add an explicit, symmetry-compatible square padding/cropping step and prove it, or qualify the guarantee to the square-lattice s
- [Abstract and Section 3.1] The abstract and introduction claim equivariance 'under arbitrary in-plane rotations,' but the algebraic framework is defined only for the cyclic group C4. Arbitrary-angle behavior is measured empirically in Fig. 1(b) at 1 degree increments (see also the rotation-robustness paragraph at the end of Supp. S3.4), not proven. The exact guarantee should be stated as C4 equivariance; arbitrary rotations should be described as empirical robustness, not as part of the algebraic equivariance claim.
- [Section 4.3, Fig. 7] The equivariance-error measurement is presented as evidence for the central property, but the protocol is underspecified. For rectangular inputs, 'rotating the input before' changes the tensor shape, so the RMS residual between the two computation paths is not defined without additional canvas manipulation. The paper does not state how the measurement handles this, and the figure therefore cannot be used to verify the algebraic guarantee on the actual benchmark geometry. Please specify the exact protocol, including padding or cropping, or restrict the claim to the square-lattice case.
minor comments (5)
- [Section 3.4, Eq. (16c)] The angle-branch shift law in Eq. (16c) has a nonzero-resultant condition that is only disclosed in Supp. S3.3. State this degeneracy condition next to Eq. (16c) to avoid overclaiming.
- [Supp. S7] The supplement repeatedly refers to 'Tab. 6 of the main paper' for the RE-DCN spectral-operator ablation. The correct table in the main text is Table 5, not Table 6.
- [Supp. S3.2] The sentence contrasting the released gate with 'the convex interpolation beta*S + (1-beta)*T stated in the earlier supplement' is confusing and self-referential. The supplement should present a single canonical formula and remove references to earlier versions.
- [Fig. 7] Define the equivariance-error metric and normalization in the main text, and state how rotated non-square canvases are compared. Currently the y-axis scale and the input preprocessing are unclear.
- [Table 1 caption] The abbreviation 'Awi.' is not expanded in the caption; use 'Awning-truck' or add a footnote.
Circularity Check
No circularity: the equivariance theorems and SpeIW monotone-warp construction are self-contained; the same-group MODA/OSSDet comparisons are not load-bearing.
full rationale
The derivation chain is not circular. SpeIW's order-preserving warp is a construction, not a fitted target: Eqs. (8a)-(8b) define positive softplus increments and cumulative-sum normalization, so monotonicity holds by definition, and the paper says so explicitly ('we obtain an order-preserving mapping by construction'). Equivariance of SpeIW is proven compositionally from the regular representation of z(x,g) and the shared coordinate network, with interpolation only along the spectral axis (Supp. S3.1). ReCoW's equivariance is also proven under explicit lattice, uniqueness, and finiteness assumptions; the supplement honestly states the conditions and floating-point caveats (Supp. S1.1, S3.2, S3.3), and the end-to-end statement (Supp. S3.4) is conditional rather than a claim forced by definition. The rectangular-input mismatch noted by the reader is a correctness/experimental-validity concern, not circularity: the proof's assumptions are not defined in terms of the target result, and no equation is silently reused as its own conclusion. The SOTA claim is supported against a wide set of external baselines (YOLO11m, O-DETR, WaveMamba, RTMDet, etc.); OSSDet and MODA are same-group citations, but the core accuracy and parameter-count comparisons are arithmetic and independently verifiable, not a fitted-input-called-prediction reduction. There is no imported uniqueness theorem and no ansatz smuggled via self-citation. Therefore no circular step meets the evidentiary bar.
Axiom & Free-Parameter Ledger
free parameters (5)
- Rotation group order |G| = C4 =
C4 (N=4)
- Fourier frequency count L in SpeIW =
L=8
- ReCoW window size and prototype grid =
W=4, K=16 (4x4)
- Numerical offsets eps_s, eps_d in monotonic mapping =
not reported (positive)
- Learnable routing scales tau and gamma in ReCoW =
learned; final values not reported
axioms (5)
- standard math Universal approximation theorem: MLPs can approximate continuous functions on compact domains.
- domain assumption C4 spatial action maps the feature lattice to itself (square grids, compatible windows).
- domain assumption Constant zero padding is C4-equivariant under the regular representation.
- domain assumption Hard spatial routing has a unique winning prototype and the angle branch resultant is nonzero.
- standard math Linear interpolation along spectral channels commutes with the group action.
read the original abstract
Existing multispectral detectors are limited by discrete spectral processing, a scale-dependent shift in the relative reliability of spectral and spatial cues across pyramid levels, and the lack of explicit rotation-equivariant geometric priors for arbitrarily oriented objects. To tackle these limitations, we propose FressDet, a fully rotation-equivariant spectral-spatial learning framework for multispectral object detection, capable of capturing the continuous, ordered nature of spectral structure and enabling reliable spectral-spatial fusion across pyramid levels under arbitrary in-plane rotations. FressDet integrates three complementary components. Spectral Implicit Warp (SpeIW) enables query-based spectral resampling via a coordinate-conditioned implicit field, yielding a monotone, order-preserving warp. Rotation-Equivariant Consistency Weighting (ReCoW) adaptively fuses spectral and spatial branches based on branch reliability, reinforcing informative cues while suppressing noise across pyramid levels. The oriented-aware head exploits group-indexed features to stably predict oriented objects without parameter replication. Taken together, FressDet learns more discriminative and robust spectral-spatial representations even under rotational perturbations. By achieving state-of-the-art performance with 93% fewer parameters on five public benchmarks, FressDet demonstrates its effectiveness and generalizability.
Figures
Reference graph
Works this paper leans on
-
[1]
In: CVPR (2018)
Cai, Z., Vasconcelos, N.: Cascade R-CNN: Delving into high quality object detec- tion. In: CVPR (2018)
2018
-
[2]
In: CVPR
Cao, Y., Bin, J., Hamari, J., Blasch, E., Liu, Z.: Multimodal object detection by channel switching and spatial attention. In: CVPR. pp. 403–411 (2023)
2023
-
[3]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog- nition
Chen, C., Qi, J., Liu, X., Bin, K., Fu, R., Hu, X., Zhong, P.: Weakly misalignment- free adaptive feature alignment for UAVs-based multimodal object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog- nition. pp. 26836–26845 (2024)
2024
-
[4]
In: ICML (2016)
Cohen, T.S., Welling, M.: Group equivariant convolutional networks. In: ICML (2016)
2016
-
[5]
In: 2017 IEEE International Conference on Computer Vision (ICCV)
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., Wei, Y.: Deformable con- volutional networks. In: 2017 IEEE International Conference on Computer Vision (ICCV). pp. 764–773 (2017).https://doi.org/10.1109/ICCV.2017.89
-
[6]
IEEE Transactions on Neural Networks and Learning Systems35(10), 13232–13245 (2024)
Fu, H., Wang, S., Duan, P., Xiao, C., Dian, R., Li, S., Li, Z.: LRAF-Net: Long-range attention fusion network for visible–infrared object detection. IEEE Transactions on Neural Networks and Learning Systems35(10), 13232–13245 (2024)
2024
-
[7]
IEEE TPAMI46(10), 6577–6593 (2024)
Fu, J., Xie, Q., Meng, D., Xu, Z.: Rotation equivariant proximal operator for deep unfolding methods in image restoration. IEEE TPAMI46(10), 6577–6593 (2024)
2024
-
[8]
In: CVPR
Girdhar, R., El-Nouby, A., Liu, Z., Singh, M., Alwala, K.V., Joulin, A., Misra, I.: ImageBind: One embedding space to bind them all. In: CVPR. pp. 15180–15190 (June 2023)
2023
-
[9]
arXiv preprint arXiv:2512.09489 (2025)
Han, S., Xu, T., Liu, P., Li, J.: MODA: The first challenging benchmark for multi- spectral object detection in aerial images. arXiv preprint arXiv:2512.09489 (2025)
arXiv 2025
-
[10]
In: Proceedings of the 31st ACM International Con- ference on Multimedia
He, X., Tang, C., Zou, X., Zhang, W.: Multi-spectral object detection via cross- modal conflict-aware learning. In: Proceedings of the 31st ACM International Con- ference on Multimedia. pp. 1465–1474 (2023)
2023
-
[11]
He, X., Tang, C., Liu, X., Zhang, W., Sun, K., Xu, J.: Object detection in hyper- spectral image via unified spectral–spatial feature aggregation. IEEE Transactions on Geoscience and Remote Sensing61, 1–13 (2023).https://doi.org/10.1109/ TGRS.2023.3307288
arXiv 2023
-
[12]
In: ICCV
Jia, X., Zhu, C., Li, M., Tang, W., Zhou, W.: LLVIP: A visible-infrared paired dataset for low-light vision. In: ICCV. pp. 3496–3504 (2021)
2021
-
[13]
Ultralytics (2023), available athttps: //github.com/ultralytics/ultralytics
Jocher, G., Chaurasia, A., Qiu, J.: YOLOv8. Ultralytics (2023), available athttps: //github.com/ultralytics/ultralytics. Accessed 5 March 2026
2023
-
[14]
Lee, C., Son, J., Shon, H., Jeon, Y., Kim, J.: FRED: Towards a full rotation- equivariance in aerial image object detection. In: AAAI. pp. 2883–2891 (2024). https://doi.org/10.1609/aaai.v38i4.28069
-
[15]
In: Computer Vision – ECCV 2014
Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L.: Microsoft COCO: Common objects in context. In: Computer Vision – ECCV 2014. pp. 740–755 (2014).https://doi.org/10.1007/978-3-319-10602- 1_48
-
[16]
IEEE Geoscience and Remote Sensing Letters21, 1–5 (2024)
Nie,J.,Sun,H.,Sun,X.,Ni,L.,Gao,L.: Cross-modalfeaturefusionandinteraction strategy for cnn-transformer-based object detection in visual and infrared remote sensing imagery. IEEE Geoscience and Remote Sensing Letters21, 1–5 (2024)
2024
-
[17]
Journal of Visual Communication and Image Representation 34, 187–203 (2016) Supplementary Material 21
Razakarivony, S., Jurie, F.: Vehicle detection in aerial imagery: A small target detection benchmark. Journal of Visual Communication and Image Representation 34, 187–203 (2016) Supplementary Material 21
2016
-
[18]
Pattern Recognition (2024)
Shen, J., Chen, Y., Liu, Y., Zuo, X., Fan, H., Yang, W.: ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detection. Pattern Recognition (2024)
2024
-
[19]
IEEE TCSVT32(10), 6700–6713 (2022)
Sun,Y.,Cao,B.,Zhu,P.,Hu,Q.:Drone-basedRGB-infraredcross-modalityvehicle detection via uncertainty-aware learning. IEEE TCSVT32(10), 6700–6713 (2022). https://doi.org/10.1109/TCSVT.2022.3168279
arXiv 2022
-
[20]
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing18, 2749–2765 (2025)
Tian, S., Wang, L., Cao, L., Kang, L., Sun, X., Tian, J., Xing, X., Shen, B., Fan, C., Du, K., Fu, C., Zhang, Y.: A dynamic cascade cross-modal coassisted network for aav image object detection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing18, 2749–2765 (2025)
2025
-
[21]
In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition
Wang, W., Dai, J., Chen, Z., Huang, Z., Li, Z., Zhu, X., Hu, X., Lu, T., Lu, L., Li, H., Wang, X., Qiao, Y.: InternImage: Exploring large-scale vision foundation models with deformable convolutions. In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition. pp. 14408–14419 (2023). https://doi.org/10.1109/CVPR52729.2023.01385
arXiv 2023
-
[22]
In: NeurIPS (2019)
Weiler, M., Cesa, G.: General E(2)-equivariant steerable CNNs. In: NeurIPS (2019)
2019
-
[23]
In: ACMMM
Xie, J., Anwer, R.M., Cholakkal, H., Nie, J., Cao, J., Laaksonen, J., Khan, F.S.: Learning a dynamic cross-modal network for multispectral pedestrian detection. In: ACMMM. pp. 4043–4052 (2022)
2022
-
[24]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Xiong, Y., Li, Z., Chen, Y., Wang, W., Zhu, X., Zhang, L., Lu, T., Dai, J., Qiao, Y.: Efficient deformable convnets: Rethinking dynamic and sparse operator for vision applications. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 5765–5775 (2024).https://doi.org/10. 1109/CVPR52733.2024.00551
arXiv 2024
-
[25]
IEEE Geoscience and Remote Sensing Letters (2024)
Xu, F., Xu, T., Hong, L., Peng, P., Guo, J., Li, J.: Enhanced spectral-spatial fusion network for multispectral object detection in ground-aerial images. IEEE Geoscience and Remote Sensing Letters (2024)
2024
-
[26]
In: CVPR
Zhang, H., Wang, Y., Dayoub, F., Sunderhauf, N.: VarifocalNet: An IoU-aware dense object detector. In: CVPR. pp. 8514–8523 (2021)
2021
-
[27]
Applied Soft Com- puting163, 111971 (2024)
Zhang, J., Chang, T., Zhao, L., Ma, J., Han, B., Zhang, L.: Efficient cross-modality feature interaction for multispectral armored vehicle detection. Applied Soft Com- puting163, 111971 (2024)
2024
-
[28]
In: Asian Conference on Computer Vision
Zhang, Q., Qiu, L., Zhou, L., An, J.: ESM-YOLO: Enhanced small target detec- tion based on visible and infrared multi-modal fusion. In: Asian Conference on Computer Vision. pp. 1454–1469 (2024)
2024
-
[29]
arXiv preprint arXiv:2401.10731 (2024)
Zhao, T., Yuan, M., Jiang, F., Wang, N., Wei, X.: Removal and selection: Im- proving RGB-infrared object detection via coarse-to-fine fusion. arXiv preprint arXiv:2401.10731 (2024)
arXiv 2024
-
[30]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Zhu, H., Dong, W., Yang, L., Li, H., Yang, Y., Ren, Y., Zhu, Q., Feng, Z., Li, C., Lin, S., et al.: WaveMamba: Wavelet-driven mamba fusion for RGB-infrared object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 11219–11229 (2025)
2025
-
[31]
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing18, 2401–2413 (2025)
Zhu, J., Zhang, H., Li, S., Wang, S., Ma, H.: Cross teaching-enhanced multispectral remote sensing object detection with transformer. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing18, 2401–2413 (2025)
2025
-
[32]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (June 2019)
Zhu, X., Hu, H., Lin, S., Dai, J.: Deformable convnets v2: More deformable, better results. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (June 2019)
2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.