REVIEW 2 major objections 2 minor 37 references
Optical subspaces from rich data guide SAR features toward simplex-ETF geometry in few-shot incremental learning.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.3
2026-06-28 06:50 UTC pith:ADIZEB4I
load-bearing objection Optical subspaces from ATR data plus principal-angle projection plus frozen ETF gets top accuracy and better NC metrics on the SAR benchmark, but no ablation isolates whether the optical transfer is actually doing work beyond the ETF term. the 2 major comments →
Optical-Guided Neural Collapse for SAR Few-Shot Class Incremental Learning
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Our optical-guided SAR FSCIL framework derives orthogonal feature subspaces from a data-rich optical ATR dataset and uses them as geometric priors. SAR features are projected onto these subspaces via principal angle constraints. The projection loss together with the classifier loss optimized on a frozen simplex-ETF geometry jointly induce neural collapse. Evaluated on a benchmark with optical and SAR ATR data across 24 target classes in one base session plus seven incremental sessions, the method records the highest final accuracy and a favorable trade-off between final performance and performance degradation. Neural collapse metrics confirm improved intra-class compactness and inter-class s
What carries the argument
Principal angle constraints that project SAR features onto orthogonal subspaces derived from optical data, transferring discriminative structure while enforcing simplex-ETF geometry through frozen classifier optimization.
Load-bearing premise
Orthogonal subspaces taken from optical imagery supply geometric priors that principal angle constraints can successfully impose on SAR features.
What would settle it
If the method is applied to the stated 24-class optical-SAR benchmark and the final accuracy falls below the strongest competing FSCIL baseline or the neural collapse metrics fail to show gains in compactness and separability.
If this is right
- The approach records the highest final accuracy among compared FSCIL methods on the 24-class benchmark.
- It delivers a favorable balance between final performance and reduced degradation across the seven incremental sessions.
- Neural collapse metrics exhibit improved intra-class compactness and inter-class separability.
- Learned features approximate the ideal simplex-ETF geometry more closely than baselines.
Where Pith is reading between the lines
- The same optical-to-SAR subspace transfer might extend to other cross-modal settings where one domain has abundant labeled data.
- Freezing the simplex-ETF geometry could support efficient model updates when new classes arrive without full retraining.
- Longer sequences of incremental sessions would test whether the transferred priors maintain stability beyond seven steps.
- Similar geometric priors could be explored for other radar modalities that suffer from data scarcity and viewpoint variation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes an optical-guided neural collapse framework for SAR few-shot class-incremental learning. Orthogonal feature subspaces are extracted from a data-rich optical ATR dataset and used as geometric priors; SAR features are projected onto these subspaces via principal-angle constraints in a projection loss, while a classifier is trained under a frozen simplex-ETF geometry. The combined losses are claimed to induce neural collapse (tighter intra-class compactness, larger inter-class angles), yielding the highest final accuracy and a favorable accuracy-degradation trade-off on a 24-class benchmark spanning one base session and seven incremental sessions, outperforming recent FSCIL methods such as NCFSCIL.
Significance. If the optical subspaces supply SAR-aligned geometric priors that measurably improve neural-collapse metrics beyond what a generic ETF regularizer achieves, the work would provide a concrete mechanism for cross-domain transfer in data-scarce SAR FSCIL and could motivate similar optical-to-SAR prior constructions in other remote-sensing incremental-learning settings. The reported accuracy gains and NC-metric improvements are the primary evidence offered; their reproducibility and mechanistic attribution remain to be verified.
major comments (2)
- [Abstract] Abstract: the central claim that 'the projection loss and the classifier loss optimized with a frozen simplex-ETF geometry jointly induce neural collapse' is presented without any equation, derivation of the principal-angle projection, or measure of subspace alignment with SAR class means. Consequently it is impossible to determine whether the optical priors are load-bearing or whether the reported NC improvements reduce to the ETF term alone.
- [Abstract] Abstract: no ablation isolating the optical-subspace component from the simplex-ETF regularizer is described. If the optical subspaces are effectively random or misaligned with SAR azimuth variability, the projection loss becomes a generic orthogonality penalty whose benefit is already available from the ETF term; this directly undermines the domain-transfer mechanism asserted as the method's novelty.
minor comments (2)
- [Abstract] Abstract: the phrase 'NCFSCIL and so on' is imprecise; the full set of baselines and their exact implementations should be listed.
- [Abstract] Abstract: neural-collapse metrics are invoked but neither the specific quantities (e.g., within-class covariance, inter-class angle) nor the numerical values are supplied, preventing direct assessment of how closely the learned geometry approximates the ideal simplex-ETF.
Simulated Author's Rebuttal
We thank the referee for the careful reading and insightful comments. We address the two major comments point-by-point below and will revise the manuscript to strengthen the presentation of the optical-guided mechanism.
read point-by-point responses
-
Referee: [Abstract] Abstract: the central claim that 'the projection loss and the classifier loss optimized with a frozen simplex-ETF geometry jointly induce neural collapse' is presented without any equation, derivation of the principal-angle projection, or measure of subspace alignment with SAR class means. Consequently it is impossible to determine whether the optical priors are load-bearing or whether the reported NC improvements reduce to the ETF term alone.
Authors: We agree that the abstract, due to length constraints, does not contain the supporting equations or quantitative alignment measure. The principal-angle projection loss is formally defined in Section 3.2 (Equations 3–5), and subspace alignment with SAR class means is quantified via principal angles in Section 4.3. In the revision we will expand the abstract to include a concise reference to the projection formulation and the alignment metric, making the load-bearing role of the optical priors explicit without exceeding abstract limits. revision: yes
-
Referee: [Abstract] Abstract: no ablation isolating the optical-subspace component from the simplex-ETF regularizer is described. If the optical subspaces are effectively random or misaligned with SAR azimuth variability, the projection loss becomes a generic orthogonality penalty whose benefit is already available from the ETF term; this directly undermines the domain-transfer mechanism asserted as the method's novelty.
Authors: We concur that an explicit ablation separating the optical-subspace projection from the frozen simplex-ETF regularizer is necessary to substantiate the cross-domain transfer claim. The current manuscript compares against ETF-using baselines but does not isolate the optical component. We will add this ablation (including a random-subspace control) in the revised version, together with an analysis of alignment under SAR azimuth variability, to demonstrate that the optical priors provide benefit beyond generic orthogonality. revision: yes
Circularity Check
No circularity identified; derivation relies on external optical priors and standard NC geometry
full rationale
The provided abstract and description contain no equations, fitting procedures, or self-referential definitions. The method extracts subspaces from a separate optical ATR dataset and applies principal-angle constraints plus a frozen simplex-ETF term drawn from the established neural-collapse literature. No step reduces a reported prediction or NC metric to a quantity defined by the method's own fitted parameters on SAR data, nor does any load-bearing claim rest on a self-citation chain. The derivation is therefore self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
read the original abstract
Few-shot class-incremental learning (FSCIL) in synthetic aperture radar imagery presents unique challenges due to severe data scarcity and SAR-specific variability. In particular, strong azimuth sensitivity in SAR induces large intra-class variation and inter-class confusion, and FSCIL sequential updates further lead to catastrophic forgetting of previously learned classes. Inspired by neural collapse, we propose an optical-guided SAR FSCIL framework, which derives orthogonal feature subspaces from a data-rich optical ATR dataset and uses them as geometric priors to guide SAR feature learning. SAR features are projected onto these orthogonal subspaces via principal angle constraints, effectively transferring discriminative structure from the optical to the SAR domain. Specifically, our projection loss and the classifier loss optimized with a frozen simplex-ETF geometry jointly induce neural collapse by concentrating features around class means while maintaining large inter-class angles. We evaluate the approach on a benchmark comprising an optical ATR dataset and a SAR ATR dataset with 24 target classes, organized into a base training session and seven incremental sessions. Compared with recent FSCIL methods including NCFSCIL and so on, our method achieves the highest final accuracy and a favorable trade-off between final performance and performance degradation. Moreover, neural collapse metrics show improved intra-class compactness and inter-class separability, indicating that the learned features more closely approximate the ideal simplex-ETF geometry.
Reference graph
Works this paper leans on
-
[1]
A comprehensive survey on SAR ATR in deep -learning era,
J. Li, Z. Yu, L. Yu, P. Cheng, J. Chen, and C. Chi, "A comprehensive survey on SAR ATR in deep -learning era," Remote Sens., vol. 15, no. 5, Art. no. 1454, 2023, doi: 10.3390/rs15051454
-
[2]
Few-Shot Class-Incremental SAR Target Recognition via Orthogonal Distributed Features,
L. Kong et al., "Few-Shot Class-Incremental SAR Target Recognition via Orthogonal Distributed Features," in IEEE Transactions on Aerospace and Electronic Systems , vol. 61, no. 1, pp. 325 -341, Feb. 2025, doi: 10.1109/TAES.2024.3443014
-
[3]
Prototype Augmentation and Self -Supervision for Incremental Learning,
F. Zhu, X. Zhang, C. Wang, F. Yin, and C. -L. Liu, “Prototype Augmentation and Self -Supervision for Incremental Learning,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2021, pp. 5871–5880
2021
-
[4]
Generalized and incremental few- shot learning by explicit learning and calibration without forgetting,
A. Kukleva, H. Kuehne, and B. Schiele, “Generalized and incremental few- shot learning by explicit learning and calibration without forgetting,” in Proc. IEEE/CVF Int. Conf. Comput. Vis., 2021, pp. 9020–9029
2021
-
[5]
icarl: Incremental classifier and representation learning
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. icarl: Incremental classifier and representation learning. In CVPR, pages 2001–2010, 2017
2001
-
[6]
Experience replay for continual learning
David Rolnick, Arun Ahuja, Jonathan Schwarz, Timothy Lillicrap, and Gregory Wayne. Experience replay for continual learning. In NeurIPS, 2019
2019
-
[7]
Deep bayesian unsupervised lifelong learning
Tingting Zhao, Zifeng Wang, Aria Masoomi, and Jennifer Dy. Deep bayesian unsupervised lifelong learning. Neural Networks, 2022
2022
-
[8]
Continual unsupervised representation learning
Dushyant Rao, Francesco Visin, Andrei Rusu, Razvan Pascanu, Yee Whye Teh, and Raia Hadsell. Continual unsupervised representation learning. NeurIPS, 32, 2019
2019
-
[9]
Dark experience for general continual learning: a strong, simple baseline
Pietro Buzzega, Matteo Boschini, Angelo Porrello, Davide Abati, and Simone Calderara. Dark experience for general continual learning: a strong, simple baseline. In NeurIPS, 2020
2020
-
[10]
Large scale incremental learning,
Y. Wu, Y. Chen, L. Wang, Y. Ye, Z. Liu, Y. Guo, and Y. Fu, "Large scale incremental learning," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2019, pp. 374-382
2019
-
[11]
Incremental learning based on anchored class centers for SAR automatic target recognition,
B. Li, Z. Cui, Z. Cao, and J. Yang, “Incremental learning based on anchored class centers for SAR automatic target recognition,” IEEE Trans. Geosci. Remote Sens., vol. 60, 2022, Art. no. 5235313
2022
-
[12]
Subspace regularizers for few -shot class incremental learning,
A. F. Akyürek, E. Akyürek, D. Wijaya, and J. Andreas, “Subspace regularizers for few -shot class incremental learning,” in Proc. 10th Int. Conf. Learn. Representations, 2022, pp. 1–19
2022
-
[13]
Pre -trained vision and language transformers are few-shot incremental learners,
K.-H. Park, K. Song, and G. -M. Park, "Pre -trained vision and language transformers are few-shot incremental learners," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2024, pp. 23881-23890
2024
-
[14]
Warping the space: Weight space rotation for class -incremental few-shot learning,
D.-Y. Kim, D. -J. Han, J. Seo, and J. Moon, “Warping the space: Weight space rotation for class -incremental few-shot learning,” in Proc. 11th Int. Conf. Learn. Represent., 2023, pp. 1–19
2023
-
[15]
Neural collapse inspired feature -classifier alignment for few -shot class incremental learning,
Y. Yang, H. Yuan, X. Li, Z. Lin, P. Torr, and D. Tao, “Neural collapse inspired feature -classifier alignment for few -shot class incremental learning,” in ICLR, 2023
2023
-
[16]
Constrained few -shot class -incremental learning,
M. Hersche, G. Karunaratne, G. Cherubini, L. Benini, A. Sebastian, and A. Rahimi, "Constrained few -shot class -incremental learning," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2022, pp. 9057- 9067
2022
-
[17]
OrCo: Towards Better Generalization via Orthogonality and Contrast for Few -Shot Class - Incremental Learning,
Noor Ahmed, Anna Kukleva and Bernt Schiele, “OrCo: Towards Better Generalization via Orthogonality and Contrast for Few -Shot Class - Incremental Learning,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., 2024, pp. 28762–28771
2024
-
[18]
Few -shot class-incremental learning,
X. Tao, X. Hong, X. Chang, S. Dong, X. Wei, and Y. Gong, "Few -shot class-incremental learning," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2020, pp. 12183-12192
2020
-
[19]
Semantic -aware knowledge distillation for few -shot class - incremental learning,
A. Cheraghian, S. Rahman, P. Fang, S. K. Roy, L. Petersson, and M. Harandi, "Semantic -aware knowledge distillation for few -shot class - incremental learning," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2021, pp. 2534-2543
2021
-
[20]
Distribution Alignment: A Unified Framework for Long - tail Visual Recognition,
S. Zhang et al. “Distribution Alignment: A Unified Framework for Long - tail Visual Recognition,” in CVPR, 2021, pp. 2361-2370
2021
-
[21]
Prevalence of neural collapse during the terminal phase of deep learning training
Vardan Papyan, XY Han, and David L Donoho. Prevalence of neural collapse during the terminal phase of deep learning training. Proceedings of the National Academy of Sciences, 117(40): 24652–24663, 2020
2020
-
[22]
Wojtowytsch, S. et al. On the emergence of simplex symmetry in the final and penultimate layers of neural network classifiers. Proceedings of Machine Learning Research, 145:1–21, 2021
2021
-
[23]
A geometric analysis of neural collapse with unconstrained features
Zhu, Z., Ding, T., Zhou, J., Li, X., You, C., Sulam, J., and Qu, Q. A geometric analysis of neural collapse with unconstrained features. Advances in Neural Information Processing Systems , 34:29820 –29834, 2021
2021
-
[24]
Perturbation analysis of neural collapse,
T. Tirer, H. Huang, and J. Niles -Weed, "Perturbation analysis of neural collapse," in Proc. 40th Int. Conf. Mach. Learn. (ICML), Proc. Mach. Learn. Res., vol. 202, 2023, pp. 34301-34329
2023
-
[25]
and Bruna, J
Tirer, T. and Bruna, J. Extended unconstrained features model for exploring deep neural collapse. In Proceedings of the 39th International Conference on Machine Learning, volume 162, pp. 21478–21505. PMLR, 2022
2022
-
[26]
NeurIPS, 2024
Evan Markou, Thalaiyasingam Ajanthan and Stephen Gould, Guiding Neural Collapse: Optimising Towards the Nearest Simplex Equiangular Tight Frame. NeurIPS, 2024
2024
-
[27]
Pca versus lda
Aleix M Martinez and Avinash C Kak. Pca versus lda. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2):228–233, 2001
2001
-
[28]
Understanding and improving transfer learning of deep models via neural collapse,
X. Li, S. Liu, J. Zhou, X. Lu, C. Fernandez -Granda, Z. Zhu, and Q. Qu, "Understanding and improving transfer learning of deep models via neural collapse," Trans. Mach. Learn. Res., 2024
2024
-
[29]
Learning with fantasy: Semantic-aware virtual contrastive constraint for few -shot class- incremental learning,
Z. Song, Y. Zhao, Y. Shi, P. Peng, L. Yuan, and Y. Tian, “Learning with fantasy: Semantic-aware virtual contrastive constraint for few -shot class- incremental learning,” in CVPR, 2023, pp. 24183–24192
2023
-
[30]
Forward compatible few -shot class -incremental learning,
D.-W. Zhou, F.-Y. Wang, H.-J. Ye, L. Ma, S. Pu, and D.-C. Zhan, “Forward compatible few -shot class -incremental learning,” in CVPR., 2022, pp. 9046–9056
2022
-
[31]
Self -promoted prototype refinement for few -shot class-incremental learning,
K. Zhu, Y. Cao, W. Zhai, J. Cheng, and Z. -J. Zha, “Self -promoted prototype refinement for few -shot class-incremental learning,” in CVPR, 2021, pp. 6801–6810
2021
-
[32]
Few shot class- incremental SAR target recognition via cosine prototype learning,
Y. Zhao, L. Zhao, D. Ding, D. Hu, G. Kuang, and L. Liu, “Few shot class- incremental SAR target recognition via cosine prototype learning,” IEEE Trans. Geosci. Remote Sens., vol. 61, 2023, Art. no. 5212718
2023
-
[33]
Mine-distill-prototypes for complete few-shot class-incremental learning in image classification,
Y. Tai, Y. Tan, S. Xiong, and J. Tian, “Mine-distill-prototypes for complete few-shot class-incremental learning in image classification,” IEEE Trans. Geosci. Remote Sens., vol. 61, 2023, Art. no. 5206013
2023
-
[34]
89, 2020
Zhi-Ze Wu, Shou-Hong Wan, Xiao-Feng Wang, Ming Tan, Le Zou, Xin - Lu Li, and Yan Chen, A benchmark data set for aircraft type recognition from remote sensing images, Applied Soft Computing, Vol. 89, 2020
2020
-
[35]
MAR20: A Benchmark for Military Aircraft Recognition in Remote Sensing Images
Wenqi Yu, Gong Cheng, Meijun Wang, Yanqing Yao, Xingxing Xie, Xiwen Yao, Junwei Han. MAR20: A Benchmark for Military Aircraft Recognition in Remote Sensing Images. Journal of Remote Sensing (Chinese), 2022
2022
-
[36]
FAIR1M: A benchmark dataset for fine -grained object recognition in high -resolution remote sensing imagery, ISPRS Journal of Photogrammetry and Remote Sensing, Vol
Xian Sun, et al. FAIR1M: A benchmark dataset for fine -grained object recognition in high -resolution remote sensing imagery, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 184, pp 116-130, 2022
2022
-
[37]
Segment anything,
A. Kirillov et al., "Segment anything," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), 2023, pp. 4015-4026
2023
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.