Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-06-30 09:10 UTCgrok-4.3pith:K3Y3WDOMrecord.jsonopen to challenge →
The pith
SFDNet detects small objects more accurately by disentangling backbone features into multiple spectral components and distilling class prototypes.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
SFDNet decomposes backbone features via an Adaptive Spectrum Disentanglement module into multiple complementary spectral components so that background distractors can be removed from each component separately, thereby constructing more discriminative object-relevant representations; it then applies Class-Wise Prototype Distillation to enforce compact representations by establishing and distilling class prototypes for object instances.
What carries the argument
The Adaptive Spectrum Disentanglement (ASD) module that decomposes backbone features into multiple complementary spectral components to discard background distractors per component.
If this is right
- Small-object detection accuracy rises on multiple challenging benchmarks.
- Representations become more robust to background interference across frequency bands.
- Objects of the same class form tighter clusters in feature space.
- The framework can be inserted into existing detection pipelines without altering the backbone.
Where Pith is reading between the lines
- The same spectral separation idea could be tested on other low-signal tasks such as tiny lesion detection in medical imaging.
- If the spectral components prove task-specific, future work might learn which frequency bands matter most rather than using a fixed decomposition.
- The prototype distillation step might transfer to semi-supervised settings where labeled small-object examples are scarce.
Load-bearing premise
Decomposing backbone features into multiple complementary spectral components will reliably produce discriminative object representations by removing background distractors from each component.
What would settle it
Evaluation on a held-out small-object benchmark where SFDNet fails to exceed the mAP or AP_S scores of prior state-of-the-art detectors.
Figures
read the original abstract
Small Object Detection (SOD) is a fundamental yet challenging problem in computer vision due to its limited spatial resolution and weak visual cues. Although recent approaches have achieved remarkable advances, the background distractors in different frequency spectra still degrade the performance. In this paper, we propose a novel small object detection framework termed SFDNet, which is capable of detecting small objects via efficient spectrum-aware feature disentanglement. Specifically, we propose an Adaptive Spectrum Disentanglement (ASD) module that decomposes backbone features into multiple complementary spectral components, aiming to construct discriminative object-relevant representations by discarding the background distractors for each component. Afterwards, to strengthen the semantic consistency of the similar objects in the same class, we propose a Class-Wise Prototype Distillation (CPD) procedure, which establishes class prototypes for the object instances and enforces the compact representation by efficient prototype distillation. Extensive experiments on multiple challenging benchmarks show that SFDNet outperforms existing state-of-the-art methods by a large margin. Our code is available at https://github.com/ManOfStory/SFDNet.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes SFDNet for small object detection, introducing an Adaptive Spectrum Disentanglement (ASD) module that decomposes backbone features into multiple complementary spectral components to discard background distractors and construct object-relevant representations, followed by a Class-Wise Prototype Distillation (CPD) procedure that builds class prototypes and enforces compact intra-class representations via distillation. Experiments on multiple SOD benchmarks report consistent outperformance over prior state-of-the-art methods, supported by ablations isolating ASD and CPD contributions and a public code release.
Significance. If the reported gains hold under the standard protocols used, the work offers a practical, spectrum-aware approach to mitigating frequency-specific background interference in SOD. Credit is due for the ablation studies that isolate module contributions and the code release, which together support reproducibility and community verification.
minor comments (2)
- [§4.3] §4.3 and Table 3: the ablation tables report mean performance but omit standard deviations or results from multiple random seeds; adding these would strengthen claims of consistent large-margin gains.
- [§3.1] §3.1, Eq. (3): the formulation of the spectrum decomposition weights could include a brief note on initialization and convergence behavior to clarify training stability.
Simulated Author's Rebuttal
We thank the referee for the positive assessment of our work, the recognition of the ASD and CPD contributions, the ablation studies, and the code release. We appreciate the recommendation for minor revision.
Circularity Check
No significant circularity in derivation chain
full rationale
The paper introduces ASD and CPD modules as novel architectural components for spectrum-aware feature disentanglement in small object detection. The central claims rest on empirical outperformance across standard benchmarks with ablations and code release, not on any derivation that reduces by construction to fitted inputs, self-citations, or renamed known results. No equations or steps in the provided text exhibit self-definitional loops, fitted parameters relabeled as predictions, or load-bearing uniqueness theorems imported from the authors' prior work. The method is self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
In: IEEE Conference on Computer Vision and Pattern Recognition
Bi, Q., Yi, J., Huang, H., Zheng, H., Zhan, H., Huang, Y., Li, Y., Wu, X., Zheng, Y.: Nightadapter: Learning a frequency adapter for generalizable night-time scene segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 23838–23849 (2025) 4
2025
-
[2]
In: 16 Y
Bian, J., Feng, M., Dong, W., Wu, F., Luo, J., Wang, Y., Shi, G.: Feature informa- tion driven position gaussian distribution estimation for tiny object detection. In: 16 Y. Guo et al. IEEE Conference on Computer Vision and Pattern Recognition. pp. 30376–30386 (2025) 10
2025
-
[3]
Pattern Recognition133, 108998 (2023) 3
Bosquet, B., Cores, D., Seidenari, L., Brea, V.M., Mucientes, M., Del Bimbo, A.: A full data augmentation pipeline for small object detection based on generative adversarial networks. Pattern Recognition133, 108998 (2023) 3
2023
-
[4]
In: IEEE Conference on Computer Vision and Pattern Recognition
Cai, Z., Vasconcelos, N.: Cascade r-cnn: Delving into high quality object detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 6154–6162 (2018) 10
2018
-
[5]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops
Chen, C., Zhang, Y., Lv, Q., Wei, S., Wang, X., Sun, X., Dong, J.: Rrnet: A hybrid detector for object detection in drone-captured images. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops. pp. 100–108 (2019) 3
2019
-
[6]
In: IEEE Conference on Computer Vision and Pattern Recognition
Chen, L., Gu, L., Li, L., Yan, C., Fu, Y.: Frequency dynamic convolution for dense image prediction. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 30178–30188 (2025) 4
2025
-
[7]
In: IEEE Conference on Computer Vision and Pattern Recognition
Chen, L., Gu, L., Zheng, D., Fu, Y.: Frequency-adaptive dilated convolution for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 3414–3425 (2024) 4
2024
-
[8]
IEEE Transactions on Geoscience and Remote Sensing60, 1–11 (2022) 11
Cheng, G., Yao, Y., Li, S., Li, K., Xie, X., Wang, J., Yao, X., Han, J.: Dual-aligned oriented detector. IEEE Transactions on Geoscience and Remote Sensing60, 1–11 (2022) 11
2022
-
[9]
IEEE Transactions on Pat- tern Analysis and Machine Intelligence45(11), 13467–13488 (2023) 9
Cheng, G., Yuan, X., Yao, X., Yan, K., Zeng, Q., Xie, X., Han, J.: Towards large- scale small object detection: Survey and benchmarks. IEEE Transactions on Pat- tern Analysis and Machine Intelligence45(11), 13467–13488 (2023) 9
2023
-
[10]
In: IEEE Conference on Computer Vision and Pattern Recognition
Dai, X., Chen, Y., Xiao, B., Chen, D., Liu, M., Yuan, L., Zhang, L.: Dynamic head: Unifying object detection heads with attentions. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 7373–7382 (2021) 12
2021
-
[11]
IEEE Transactions on Geoscience and Remote Sensing63, 1–14 (2025) 12
Du, Z., Hu, Z., Zhao, G., Jin, Y., Ma, H.: Cross-layer feature pyramid transformer for small object detection in aerial images. IEEE Transactions on Geoscience and Remote Sensing63, 1–14 (2025) 12
2025
-
[12]
In: Proceedings of the IEEE/CVF winter conference on applications of computer vision
Fang, H., Han, B., Zhang, S., Zhou, S., Hu, C., Ye, W.M.: Data augmenta- tion for object detection via controllable diffusion models. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision. pp. 1257–1266 (2024) 3
2024
-
[13]
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Gu, A., Dao, T.: Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.00752 (2023) 4
work page internal anchor Pith review Pith/arXiv arXiv 2023
-
[14]
IEEE Transactions on Geoscience and Remote Sensing60, 1–11 (2021) 11
Han, J., Ding, J., Li, J., Xia, G.S.: Align deep features for oriented object detection. IEEE Transactions on Geoscience and Remote Sensing60, 1–11 (2021) 11
2021
-
[15]
In: IEEE Conference on Computer Vision and Pattern Recognition
Hatamizadeh, A., Kautz, J.: Mambavision: A hybrid mamba-transformer vision backbone. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 25261–25270 (2025) 4
2025
-
[16]
In: IEEE Conference on Computer Vision and Pattern Recognition
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 770–778 (2016) 10
2016
-
[17]
In: IEEE International Conference on Computer Vi- sion
Kim, J.U., Park, S., Ro, Y.M.: Robust small-scale pedestrian detection with cued recall via memory learning. In: IEEE International Conference on Computer Vi- sion. pp. 3050–3059 (2021) 2
2021
-
[18]
Augmentation for small object detection
Kisantal, M., Wojna, Z., Murawski, J., Naruniec, J., Cho, K.: Augmentation for small object detection. arXiv preprint arXiv:1902.07296 (2019) 3
work page internal anchor Pith review Pith/arXiv arXiv 1902
-
[19]
In: European Conference on Computer Vision
Law, H., Deng, J.: Cornernet: Detecting objects as paired keypoints. In: European Conference on Computer Vision. pp. 734–750 (2018) 12 SFDNet 17
2018
-
[20]
In: IEEE Conference on Computer Vision and Pattern Recognition
Li, C., Dai, P., Li, J., Yao, S., Jiang, Y., Zheng, Z.: Dyfclt: Dynamic frequency- decoupled cross-modal learning transformer for multimodal tiny object detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 11313– 11323 (2026) 2
2026
-
[21]
In: IEEE Conference on Computer Vision and Pattern Recognition
Li, W., Chen, Y., Hu, K., Zhu, J.: Oriented reppoints for aerial object detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 1829–1838 (2022) 2, 11
2022
-
[22]
arXiv preprint arXiv:2507.23601 (2025) 12
Li, X., Fu, K., Zhao, Q.: Mamba-based efficient spatio-frequency motion perception for video camouflaged object detection. arXiv preprint arXiv:2507.23601 (2025) 12
-
[23]
In: IEEE International Conference on Computer Vision
Lin, T.Y., Goyal, P., Girshick, R., He, K., Doll´ ar, P.: Focal loss for dense object detection. In: IEEE International Conference on Computer Vision. pp. 2980–2988 (2017) 11, 12
2017
-
[24]
IEEE Transactions on Geoscience and Remote Sensing62, 1–15 (2024) 2, 3, 10, 12
Liu, H.I., Tseng, Y.W., Chang, K.C., Wang, P.J., Shuai, H.H., Cheng, W.H.: A denoising fpn with transformer r-cnn for tiny object detection. IEEE Transactions on Geoscience and Remote Sensing62, 1–15 (2024) 2, 3, 10, 12
2024
-
[25]
In: International Conference on Learning Representations (2022) 10
Liu, S., Li, F., Zhang, H., Yang, X., Qi, X., Su, H., Zhu, J., Zhang, L.: DAB-DETR: dynamic anchor boxes are better queries for DETR. In: International Conference on Learning Representations (2022) 10
2022
-
[26]
In: Advances in Neural Information Processing Systems
Liu, Y., Tian, Y., Zhao, Y., Yu, H., Xie, L., Wang, Y., Ye, Q., Jiao, J., Liu, Y.: Vmamba: Visual state space model. In: Advances in Neural Information Processing Systems. pp. 103031–103063 (2024) 4, 12
2024
-
[27]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops
Lu, W., Chen, S.B., Li, H.D., Shu, Q.L., Ding, C.H., Tang, J., Luo, B.: Legnet: A lightweight edge-gaussian network for low-quality remote sensing image object de- tection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops. pp. 2865–2874 (2025) 11
2025
-
[28]
IEEE Transactions on Geoscience and Remote Sensing62, 1–13 (2024) 11
Lu, W., Chen, S.B., Shu, Q.L., Tang, J., Luo, B.: Decouplenet: A lightweight backbone network with efficient feature decoupling for remote sensing visual tasks. IEEE Transactions on Geoscience and Remote Sensing62, 1–13 (2024) 11
2024
-
[29]
In: IEEE International Conference on Computer Vision
Ma, X., Ni, Z., Chen, X.: Tinyvim: Frequency decoupling for tiny hybrid vision mamba. In: IEEE International Conference on Computer Vision. pp. 23519–23529 (2025) 4
2025
-
[30]
In: IEEE Confer- ence on Computer Vision and Pattern Recognition
Marques, J.H.L., Murrugarra-Llerena, J., Jung, C.R.: Gaucho: Gaussian distribu- tions with cholesky decomposition for oriented object detection. In: IEEE Confer- ence on Computer Vision and Pattern Recognition. pp. 3593–3602 (2025) 11
2025
-
[31]
IEEE Transactions on Pattern Analysis and Machine Intel- ligence45(4), 4932–4944 (2022) 11
Nie, G., Huang, H.: Multi-oriented object detection in aerial images with double horizontal rectangles. IEEE Transactions on Pattern Analysis and Machine Intel- ligence45(4), 4932–4944 (2022) 11
2022
-
[32]
In: IEEE Conference on Computer Vision and Pattern Recognition
Qiao, S., Chen, L.C., Yuille, A.: Detectors: Detecting objects with recursive feature pyramid and switchable atrous convolution. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 10213–10224 (2021) 10
2021
-
[33]
IEEE Transactions on Pattern Analysis and Machine Intelligence39(6), 1137–1149 (2016) 10, 11, 12
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: Towards real-time object detec- tion with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence39(6), 1137–1149 (2016) 10, 11, 12
2016
-
[34]
In: IEEE/RSJ International Conference on Intelligent Robots and Systems
Shi, S., Fang, Q., Xu, X., Zhao, T.: Similarity distance-based label assignment for tiny object detection. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 13711–13718 (2024) 10
2024
-
[35]
In: AAAI Conference on Artificial Intelligence
Shi, Z., Hu, J., Ren, J., Ye, H., Yuan, X., Ouyang, Y., He, J., Ji, B., Guo, J.: Hs-fpn: High frequency and spatial perception fpn for tiny object detection. In: AAAI Conference on Artificial Intelligence. pp. 6896–6904 (2025) 2, 3, 10, 11, 12 18 Y. Guo et al
2025
-
[36]
In: IEEE International Conference on Computer Vision
Sun, H., Li, Y., Yang, L., Cao, X., Zhang, B.: Uncertainty-aware gradient stabiliza- tion for small object detection. In: IEEE International Conference on Computer Vision. pp. 8407–8417 (2025) 11
2025
-
[37]
In: IEEE Conference on Computer Vision and Pattern Recognition
Sun, H., Wang, R., Li, Y., Yang, L., Lin, S., Cao, X., Zhang, B.: Set: Spectral enhancement for tiny object detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 4713–4723 (2025) 2, 10
2025
-
[38]
In: IEEE Conference on Computer Vision and Pattern Recognition
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al.: Sparse r-cnn: End-to-end object detection with learnable proposals. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 14454–14463 (2021) 12
2021
-
[39]
In: IEEE International Conference on Computer Vision
Tian, Z., Shen, C., Chen, H., He, T.: Fcos: Fully convolutional one-stage object detection. In: IEEE International Conference on Computer Vision. pp. 9627–9636 (2019) 12
2019
-
[40]
In: Advances in Neural Infor- mation Processing Systems
Vu, T., Jang, H., Pham, T.X., Yoo, C.D.: Cascade RPN: delving into high-quality region proposal network with adaptive convolution. In: Advances in Neural Infor- mation Processing Systems. pp. 1430–1440 (2019) 12
2019
-
[41]
In: IEEE International Conference on Pattern Recognition
Wang, J., Yang, W., Guo, H., Zhang, R., Xia, G.S.: Tiny object detection in aerial images. In: IEEE International Conference on Pattern Recognition. pp. 3791–3798 (2021) 9
2021
-
[42]
In: IEEE Conference on Com- puter Vision and Pattern Recognition
Wang, K., Fu, X., Huang, Y., Cao, C., Shi, G., Zha, Z.J.: Generalized uav object detection via frequency domain disentanglement. In: IEEE Conference on Com- puter Vision and Pattern Recognition. pp. 1064–1073 (2023) 4
2023
-
[43]
In: Proceedings of the ACM International Conference on Multimedia
Wu, J., Zhou, C., Zhang, Q., Yang, M., Yuan, J.: Self-mimic learning for small- scale pedestrian detection. In: Proceedings of the ACM International Conference on Multimedia. pp. 2012–2020 (2020) 2
2012
-
[44]
In: International Conference on Learning Representations (2025) 4, 10, 12
Xiao, C., Li, M., Zhang, Z., Meng, D., Zhang, L.: Spatial-mamba: Effective visual state space models via structure-aware state fusion. In: International Conference on Learning Representations (2025) 4, 10, 12
2025
-
[45]
In: IEEE International Conference on Computer Vision
Xie, X., Cheng, G., Wang, J., Yao, X., Han, J.: Oriented r-cnn for object detection. In: IEEE International Conference on Computer Vision. pp. 3520–3529 (2021) 11
2021
-
[46]
ISPRS Journal of Photogrammetry and Remote Sensing190, 79–93 (2022) 3
Xu, C., Wang, J., Yang, W., Yu, H., Yu, L., Xia, G.S.: Detecting tiny objects in aerial images: A normalized wasserstein distance and a new benchmark. ISPRS Journal of Photogrammetry and Remote Sensing190, 79–93 (2022) 3
2022
-
[47]
In: European Conference on Computer Vision
Xu, C., Wang, J., Yang, W., Yu, H., Yu, L., Xia, G.S.: Rfla: Gaussian receptive field based label assignment for tiny object detection. In: European Conference on Computer Vision. pp. 526–543 (2022) 3, 10, 12
2022
-
[48]
IEEE Trans- actions on Pattern Analysis and Machine Intelligence48(3), 3167–3184 (2026) 11
Xu, C., Zhang, R., Yang, W., Zhu, H., Xu, F., Ding, J., Xia, G.S.: Oriented tiny ob- ject detection: A dataset, benchmark, and dynamic unbiased learning. IEEE Trans- actions on Pattern Analysis and Machine Intelligence48(3), 3167–3184 (2026) 11
2026
-
[49]
IEEE Transactions on Pattern Analysis and Machine Intelligence43(4), 1452–1459 (2020) 2, 11
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.S., Bai, X.: Gliding vertex on the horizontal bounding box for multi-oriented object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence43(4), 1452–1459 (2020) 2, 11
2020
-
[50]
In: IEEE Conference on Computer Vision and Pattern Recognition
Yang, C., Huang, Z., Wang, N.: Querydet: Cascaded sparse query for accelerating high-resolution small object detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 13668–13677 (2022) 2, 10
2022
-
[51]
In: IEEE International Conference on Computer Vision
Yang, Z., Liu, S., Hu, H., Wang, L., Lin, S.: Reppoints: Point set representation for object detection. In: IEEE International Conference on Computer Vision. pp. 9657–9666 (2019) 12
2019
-
[52]
IEEE Transactions on Image Processing34, 3533–3546 (2025) 2 SFDNet 19
Yao, S., Guo, Y., Yan, Y., Ren, W., Cao, X.: Unctrack: Reliable visual object tracking with uncertainty-aware prototype memory network. IEEE Transactions on Image Processing34, 3533–3546 (2025) 2 SFDNet 19
2025
-
[53]
IEEE Transactions on Image Processing33, 5936–5948 (2024) 9
Yao, S., Sun, H., Xiang, T.Z., Wang, X., Cao, X.: Hierarchical graph interaction transformer with dynamic token clustering for camouflaged object detection. IEEE Transactions on Image Processing33, 5936–5948 (2024) 9
2024
-
[54]
IEEE Transactions on Image Processing35, 1127–1142 (2026) 11, 12
Yuan, X., Cheng, G., Cheng, J., Yao, R., Han, J.: Unc-sod: An uncertainty learning framework for small object detection. IEEE Transactions on Image Processing35, 1127–1142 (2026) 11, 12
2026
-
[55]
In: IEEE International Confer- ence on Computer Vision
Yuan, X., Cheng, G., Yan, K., Zeng, Q., Han, J.: Small object detection via coarse- to-fine proposal generation and imitation learning. In: IEEE International Confer- ence on Computer Vision. pp. 6317–6327 (2023) 2, 3, 10, 11, 12
2023
-
[56]
In: International Conference on Learning Representations (2023) 10
Zhang, H., Li, F., Liu, S., Zhang, L., Su, H., Zhu, J., Ni, L.M., Shum, H.Y.: DINO: DETR with improved denoising anchor boxes for end-to-end object detection. In: International Conference on Learning Representations (2023) 10
2023
-
[57]
In: IEEE Conference on Computer Vision and Pattern Recognition
Zhang, S., Chi, C., Yao, Y., Lei, Z., Li, S.Z.: Bridging the gap between anchor- based and anchor-free detection via adaptive training sample selection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 9759–9768 (2020) 12
2020
-
[58]
IEEE Transactions on Geoscience and Remote Sensing 62, 1–16 (2024) 2
Zhou, Z., Zhu, Y.: Kldet: Detecting tiny objects in remote sensing images via kullback–leibler divergence. IEEE Transactions on Geoscience and Remote Sensing 62, 1–16 (2024) 2
2024
-
[59]
In: Inter- national Conference on Machine Learning
Zhu, L., Liao, B., Zhang, Q., Wang, X., Liu, W., Wang, X.: Vision Mamba: Effi- cient visual representation learning with bidirectional state space model. In: Inter- national Conference on Machine Learning. pp. 62429–62442 (2024) 4
2024
-
[60]
In: International Conference on Learning Representations (2021) 12
Zhu, X., Su, W., Lu, L., Li, B., Wang, X., Dai, J.: Deformable detr: Deformable transformers for end-to-end object detection. In: International Conference on Learning Representations (2021) 12
2021
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.