REVIEW 3 major objections 4 minor 31 references
Blind Underwater Image Restoration using Co-Operational Regressor Networks
T0 review · 3 major / 4 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read A pair of cooperating regressors—an apprentice that restores and a master that scores PSNR—outperforms the prior state of the art on underwater image restoration with about nine times fewer parameters.
desk verdict CoRe-Net's 0.38 dB SOTA gain over a transformer with 9x fewer parameters is plausible but rests on a single unreplicated run; the cooperative regressor idea itself is worth a serious look. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the two-network loop: the Apprentice Regressor (AR), a residual U-Net with 7.2 million parameters built from Self-Organized Operational Neural Network (Self-ONN) layers, and the Master Regressor (MR), a small stack of operational and dense layers that regresses a normalized PSNR score. In a Self-ONN, each neuron replaces a fixed convolution with a Taylor-polynomial operator $\psi(w,x) = w_0 + w_1 x + \dots + w_Q x^Q$, where $Q$ controls the degree of nonlinearity; $Q=1$ recovers a conventional CNN. During training, the MR minimizes the L1 distance between its estimate and the true PSNR of the AR output, normalized by a target PSNR, and the AR minimizes a weighted sum of the MR feedback, the negative true PSNR, and focal frequency loss. This closed feedback loop is what the paper calls PSNR boosting.
What would settle it
On a synthetic test set rendered with known clean scenes and known water attenuation coefficients, measure CoRe-Net's restored PSNR and color error against the known clean images; if its margin over the U-Shape Transformer shrinks below statistical significance, or its color error exceeds the Transformer's, the claimed superiority is an artifact of the manually selected LSUI references rather than true scene recovery.
Extended reading notes
Core claim
CoRe-Net's central discovery, on the authors' own terms, is that cooperation beats competition for this restoration task: two networks that improve each other's loss (rather than a generator and discriminator that fight) reach the highest reported PSNR on the LSUI test split, 24.54 dB, using only 7.2 million parameters. The Master Regressor is trained to output the PSNR between the apprentice's output and the target, with ground-truth pairs mapped to a normalized target of 1, and the Apprentice Regressor is trained with a loss that combines that feedback, the true PSNR, and focal frequency loss. The same Self-ONN backbone used for both networks lets each convolutional kernel be a learnable low-degree polynomial nonlinearity, which the paper argues gives the pair more expressive capacity per parameter than plain convolutions or the transformer baseline.
Load-bearing premise
The load-bearing premise is that the LSUI ground-truth images, created by running 18 restoration methods and having volunteers pick the best, are clean enough to serve as true references, because both the PSNR numbers and the Master Regressor's training feedback are anchored to them.
Editorial extensions
If this is right
- A 7.2-million-parameter restorer beats the 65.6-million-parameter U-Shape Transformer by 0.38 dB on the LSUI test split, so the state of the art does not require a transformer-scale model.
- Restoring a $256 \times 256 \times 3$ image takes about 6.1 ms on a single CPU, roughly 150 times faster than real-time, which makes the method plausible for low-power underwater vehicles.
- Because the Master Regressor supplies a differentiable PSNR target, the same cooperative loop should transfer to any image restoration task where PSNR is the main metric.
- A second pass through the trained AR improves perceived color and sharpness beyond the dataset's ground-truth images, suggesting the restored outputs could be used to augment or revise the LSUI reference set.
Reading between the lines
- If the LSUI ground truths carry the residual green casts the authors demonstrate, the reported 24.54 dB advantage may partly measure agreement with a subjective proxy; a true head-to-head would need a no-reference perceptual evaluation or a physically synthesized test set.
- The MR's input could be swapped from a PSNR regressor to a learned no-reference quality score, which would let CoRe-Net train on unpaired underwater images and avoid the dataset's biased references entirely.
- The same cooperative schedule could be applied to other blind restoration problems named in the paper, such as night-time or misty images, where paired clean references are also scarce.
- Since the second-pass outputs often look cleaner than the GT, a practical extension is a self-improving loop that uses the second-pass output as a soft target for further training, though the authors do not propose this.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Co-Operational Regressor Networks (CoRe-Net) for blind underwater image restoration. The architecture pairs an Apprentice Regressor (AR), a Self-ONN-based U-Net that performs the image-to-image transformation, with a Master Regressor (MR) that learns to regress the PSNR of the AR output and feeds this quality estimate back into the AR loss. The training objective also includes a direct PSNR term and a focal frequency loss. Experiments on the LSUI benchmark report a first-pass PSNR of 24.54 dB with 7.2 million parameters, compared with 24.16 dB for the 65.6-million-parameter U-Shape Transformer, together with same-backbone operational U-Net and operational GAN baselines. A second-pass variant is presented as producing visually better outputs than the ground truth despite a lower PSNR.
Significance. If the reported results are robust, the paper makes a useful contribution: the cooperative MR feedback mechanism is a plausible alternative to adversarial training, the same-backbone internal comparison (Op. U-Net and Op. GAN) helps isolate the effect of the MR, and the compact 7.2 M parameter model with publicly released code could be attractive for practical underwater restoration. However, the central state-of-the-art claim rests on a single unreplicated training run with a small numerical margin over the prior method, and the authors themselves acknowledge that the LSUI ground truth is a subjective, algorithm-selected proxy. Both issues need to be addressed before the paper's main conclusions are fully supported.
major comments (3)
- [Section III.B / III.C, Table 1] The central claim that CoRe-Net exceeds the U-Shape Transformer (24.54 dB vs. 24.16 dB) is supported by only a single number per method. The experimental setup uses batch size 1 and up to 5000 back-propagation iterations, and no seeds, repeated runs, error bars, or significance tests are reported. With a 0.38 dB margin, run-to-run and initialization variability can change the ranking, especially because the MR is trained jointly against a moving target during training. Please report the mean and standard deviation over multiple seeds (or equivalent repeated evaluations) and provide a paired statistical test or bootstrap confidence interval for the PSNR comparison.
- [Section II.B, Equation (6)] Equation (6) is ambiguous as printed. The notation ||MR(B), α/Target PSNR||_{L1} is not a standard L1 loss between a network output and a target; it should be written explicitly, e.g., L1(MR(B), α/Target_PSNR), with α defined in Eq. (5). In addition, the second term is written as ||MR(A), 1||_{L1}, but the surrounding text says that for the ground truth A_Truth the target is 1, so it is unclear whether the MR input is the original degraded image A or the ground truth A_Truth. Please clarify the exact inputs and targets for both MR terms. Finally, the sensitivity of the method to the user-defined Target PSNR = 40 dB should be discussed or experimentally probed, because this constant appears directly in the MR loss.
- [Section III.D] The claim that the two-pass CoRe-Net can 'improve the GT images' in the LSUI dataset is supported only by selected visual examples and by a mean PSNR of 20.57 dB that is about 4 dB lower than the first-pass value. Since the paper itself states that the LSUI GT images are only as good as the restoration method manually selected by volunteers, the assertion of visual superiority needs a quantitative perceptual evaluation, a user study, or established no-reference image-quality metrics. Without such evidence, the second-pass result should be framed as a qualitative observation rather than a demonstrated benchmark improvement.
minor comments (4)
- [Section III.E] The reported processing time of 6.1 ms per 256x256x3 image corresponds to roughly 164 frames per second, which is about 5.5 times faster than a 30 fps real-time requirement, not 'approximately 150 times faster than the real-time requirements' as stated. Please correct this calculation or clarify the assumed real-time rate.
- [Section II.B, Equation (4)] The notation max(X_i) is used for the dynamic range of the normalized images and is defined as 1 - (-1) = 2. This is not the maximum pixel amplitude, which would be 1, so using a distinct symbol such as MAX or R would avoid confusion with the standard PSNR definition.
- [References] Reference [3] appears to be a duplicate of reference [2] rather than a distinct source; please provide the correct citation or remove the duplicate entry.
- [Table 1] The complexity comparison reports only parameter counts. Since the paper emphasizes real-time suitability, reporting multiply-accumulate operations or measured inference time for the competing methods would make the efficiency claim more concrete.
Circularity Check
No circularity: the reported PSNR is computed on a held-out test split, and the PSNR terms in the training losses are standard optimization objectives, not test-time predictions.
full rationale
I walked the paper's derivation chain from the loss definitions (Eqs. 4-7) through the experimental setup and the reported results. The central quantitative claim is the first-pass PSNR of 24.54 dB on the LSUI test set. The paper explicitly partitions the dataset: 'The LSUI dataset is partitioned in to train and test sets as 90% and 10% respectively as in [1] for fair comparative evaluations.' The reported PSNR is therefore measured on held-out data, not on the training set. The AR loss in Eq. (7) contains a direct negative PSNR term and the MR loss in Eq. (6) regresses a normalized PSNR target; these are training objectives, and optimizing a metric during training while reporting it on a held-out test set is standard practice, not circularity. The MR is trained to predict PSNR, but Table 1 reports actual PSNR values computed between restored outputs and ground-truth references, not MR predictions. The paper's reliance on Self-ONN components cites prior works by the same authors, but these are published architectures with public implementations (e.g., FastONN) and are used as building blocks; the state-of-the-art claim is tested empirically against external baselines rather than derived from those citations. The acknowledged subjectivity of LSUI ground-truth images and the unsupported second-pass 'better than GT' visual claim are validity or benchmark-quality concerns, not circularity. I found no step where a prediction or result is equivalent to its inputs by construction.
Assumptions & free parameters
free parameters (4)
- Loss coefficient epsilon =
3
- Loss coefficient beta =
0.05
- Loss coefficient phi =
100
- Target PSNR =
40 dB
assumptions (3)
- domain assumption LSUI ground truth images are valid references for restoration quality.
- domain assumption PSNR is the primary measure of restoration quality.
- standard math Taylor expansion approximation in Eq. (1)-(2) is valid for Self-ONN nodal operators.
invented entities (1)
-
Master Regressor (MR)
Cite this review
Pith. "Pith review of Blind Underwater Image Restoration using Co-Operational Regressor Networks." pith.science (2026). https://pith.science/paper/5P54JE2E
@misc{pith2026241203995,
author = {Pith},
title = {Pith review of: Blind Underwater Image Restoration using Co-Operational Regressor Networks},
year = {2026},
howpublished = {\url{https://pith.science/paper/5P54JE2E}},
note = {Machine review of arXiv:2412.03995}
}
read the original abstract
The exploration of underwater environments is essential for applications such as biological research, archaeology, and infrastructure maintenanceHowever, underwater imaging is challenging due to the waters unique properties, including scattering, absorption, color distortion, and reduced visibility. To address such visual degradations, a variety of approaches have been proposed covering from basic signal processing methods to deep learning models; however, none of them has proven to be consistently successful. In this paper, we propose a novel machine learning model, Co-Operational Regressor Networks (CoRe-Nets), designed to achieve the best possible underwater image restoration. A CoRe-Net consists of two co-operating networks: the Apprentice Regressor (AR), responsible for image transformation, and the Master Regressor (MR), which evaluates the Peak Signal-to-Noise Ratio (PSNR) of the images generated by the AR and feeds it back to AR. CoRe-Nets are built on Self-Organized Operational Neural Networks (Self-ONNs), which offer a superior learning capability by modulating nonlinearity in kernel transformations. The effectiveness of the proposed model is demonstrated on the benchmark Large Scale Underwater Image (LSUI) dataset. Leveraging the joint learning capabilities of the two cooperating networks, the proposed model achieves the state-of-art restoration performance with significantly reduced computational complexity and often presents such results that can even surpass the visual quality of the ground truth with a 2-pass application. Our results and the optimized PyTorch implementation of the proposed approach are now publicly shared on GitHub.
Reference graph
Works this paper leans on
-
[1]
U -Shape Transformer for Underwater Image Enhancement,
L. Peng, C. Zhu and L. Bian , "U -Shape Transformer for Underwater Image Enhancement," in IEEE Transactions on Image Processing, vol. 32, pp. 3066-3079, 2023, doi: 10.1109/TIP.2023.3276332
arXiv 2023
-
[2]
Underwater Image Enhancement by Wavelength Compensation and Dehazing,
J. Y. Chiang and Y. -C. Chen, "Underwater Image Enhancement by Wavelength Compensation and Dehazing," in IEEE Transactions on Image Processing, vol. 21, no. 4, pp. 1756 -1769, April 2012, doi: 10.1109/TIP.2011.2179666
arXiv 2012
-
[3]
Underwater Image Enhancement by Wavelength Compensation and Dehazing," in IEEE Transactions on Image Processing
-
[4]
Underwater Image Enhancement With a Deep Residual Framework,
P. Liu, G. Wang, H. Qi, C. Zhang, H. Zheng and Z. Yu, "Underwater Image Enhancement With a Deep Residual Framework," in IEEE Access, vol. 7, pp. 94614-94629, 2019, doi: 10.1109/ACCESS.2019.2928976
arXiv 2019
-
[5]
Deep Residual Learning for Image Recognition,
K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp. 770 -778, doi: 10.1109/CVPR.2016.90
-
[6]
W. Luo, S. Duan and J. Zheng, "Underwater Image Restoration and Enhancement Based on a Fusion Algorithm With Color Balance, Contrast Optimization, and Histogram Stretching," in IEEE Access, vol. 9, pp. 31792-31804, 2021, doi: 10.1109/ACCESS.2021.3060947
arXiv 2021
-
[7]
Underwater Image Restoration through Color Correction and UW -Net
Awan, Hafiz Shakeel Ahmad, and Muhammad Tariq Mahmood. 2024. "Underwater Image Restoration through Color Correction and UW -Net" Electronics 13, no. 1: 199. https://doi.org/10.3390/electronics13010199
-
[8]
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde -Farley D, Ozair S, et al. Generative adversarial nets. In: Advances in neural information processing systems. 2014. p. 2672–80
work page 2014
Show all 31 references
-
[9]
Improved training of Wasserstein GANs
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. Improved training of Wasserstein GANs. In Proceedings of the 31st International Conference on Neural Information Processing Systems, pages 5769– 5779, 2017
2017
-
[10]
Self-Organized Operational Neural Networks with Generative Neurons
S. Kiranyaz, J. Malik, H. B. Abdallah, T. Ince, A. Iosifidis, M. Gabbouj, “Self-Organized Operational Neural Networks with Generative Neurons”, IEEE Trans. Of Neural Networks and Learning Systems, (Under Review) arXiv preprint arXiv:2004.11778, 2020
2004 arXiv
-
[11]
Self-Organized Operational Neural Networks with Generative Neurons,
S. Kiranyaz, J. Malik, H. B. Abdallah, T. Ince, A. Iosifidis, and M. Gabbouj, “Self-Organized Operational Neural Networks with Generative Neurons,” Neural Networks, vol. 140, pp. 294 -308, 2021, doi: 10.1016/j.neunet.2021.02.028
2021 doi
-
[12]
Self -Organized Operational Neural Networks for Severe Image Restoration Problems,
J. Malik, S. Kiranyaz, and M. Gabbouj, “Self -Organized Operational Neural Networks for Severe Image Restoration Problems,” Neural Networks, vol. 135, pp. 201-211, 2021, doi: 10.1016/j.neunet.20
2021 doi
-
[13]
Malik, S
J. Malik, S. Kiranyaz, and M. Gabbouj. (2020). FastONN--Python based open-source GPU implementation for Operational Neural Networks. arXiv. [Online]. Available: https://arxiv.org/abs/2006.02267
2020 arXiv
-
[14]
Real-Time Glaucoma Detection From Digital Fundus Images Using Self-ONNs,
O. C. Devecioglu, J. Malik, T. Ince, S. Kiranyaz, E. Atalay, and M. Gabbouj, “Real-Time Glaucoma Detection From Digital Fundus Images Using Self-ONNs,” IEEE Access, vol. 9, pp. 140031-140041, 2021. doi: 10.1109/ACCESS.2021.3118102 Blind Underwater Image Restoration using Co-Op...
2021
-
[15]
RealTime Patient-Specific ECG Classification by 1D Self -Operational Neural Networks,
J. Malik, O. C. Devecioglu, S. Kiranyaz, T. Ince, and M. Gabbouj, “RealTime Patient-Specific ECG Classification by 1D Self -Operational Neural Networks,” IEEE Trans. on Biomedical Engineering, 2021. doi: 10.1109/TBME.2021.3135622
2021
-
[16]
Robust Peak Detection for Holter ECGs by Self-Organized Operational Neural Networks,
M. Gabbouj, S. Kiranyaz, J. Malik, M. U. Zahid, T. Ince, M. Chowdhury, A. Khandakar, and A. Tahir, “Robust Peak Detection for Holter ECGs by Self-Organized Operational Neural Networks,” in IEEE Trans. on Neural Networks and Learning Systems, April 2022
2022
-
[17]
Global ECG Classification by Self-Operational Neural Networks with Feature Injection
M. Uzair, S. Kiranyaz, and M. Gabbouj, “Global ECG Classification by Self-Operational Neural Networks with Feature Injection”, IEEE Transactions on Biomedical Engineering, vol. 70, no. 1, pp. 205 -215, 2022, doi: 10.1109/TBME.2022.3187874
2022
-
[18]
BM3D vs 2 -Layer ONN
J. Malik, S. Kiranyaz, and M. Gabbouj, “BM3D vs 2 -Layer ONN”, in Proc. of IEEE Int. Conference on Image Processing (ICIP), Sep. 2021, pp. 1994-1998, doi:10.1109/ICIP42928.2021.9506240
2021
-
[19]
Blind ECG Restoration by Operational Cycle -GANs,
S. Kiranyaz, O. C. Devecioglu, T. Ince, J. Malik, M. Chowdhury, T. Hamid, R. Mazhar, A. Khandakar, A. Tahir, T. Rahman, and M. Gabbouj, “Blind ECG Restoration by Operational Cycle -GANs,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 12, pp. 3572-3581, 2022, doi: 1...
2022
-
[20]
Malik, S
J. Malik, S. Kiranyaz, and M. Gabbouj. (2020). Operational vs Convolutional Neural Networks for Image Denoising. arXiv. [Online]. Available: https://arxiv.org/abs/2009.00612
2020 arXiv
-
[21]
Zero -shot motor health monitoring by blind domain transition,
S. Kiranyaz, O.C. Devecioglu, A. Alhams, S. Sassi, T. Ince, O. Abdeljaber, O. Avci, and M. Gabbouj, “Zero -shot motor health monitoring by blind domain transition,” Mechanical Systems and Signal Processing, vol. 210, 2024, pp. 111147, doi: 10.1016/j.ymssp.2024.111147
2024
-
[22]
Improved Active Fire Detection Using Operational U -nets,
O. C. Devecioglu, M. Ahishali, F. Sohrab, T. Ince, and M. Gabbouj, "Improved Active Fire Detection Using Operational U -nets," in 2023 Photonics & Electromagnetics Research Symposium (PIERS), 2023, pp. 692-697, doi: 10.1109/PIERS59004.2023.10221241
2023
-
[23]
Early Bearing Fault Diagnosis of Rotating Machinery by 1D Self-Organized Operational Neural Networks,
T. Ince, J. Malik, O.C. Devecioglu, S. Kiranyaz, O. Avci, L. Eren, and M. Gabbouj, "Early Bearing Fault Diagnosis of Rotating Machinery by 1D Self-Organized Operational Neural Networks," IEEE Access, vol. 9, pp. 139260-139270, 2021, doi: 10.1109/ACCESS.2021.3117603
2021
-
[24]
Kiranyaz, O
S. Kiranyaz, O. C. Devecioglu, A. Alhams, S. Sassi, T. Ince, O. Abdeljaber, O. Avci, and M. Gabbouj. (2022). Zero -Shot Motor Health Monitoring by Blind Domain Transition. ArXiv. [Online]. Available: https://arxiv.org/abs/2212.06154
2022 arXiv
-
[25]
Focal Frequency Loss for Image Reconstruction and Synthesis,
L. Jiang, B. Dai, W. Wu and C. C. Loy, "Focal Frequency Loss for Image Reconstruction and Synthesis," 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 2021, pp. 13899 - 13909, doi: 10.1109/ICCV48922.2021.01366
2021
-
[26]
[Online]
Underwater-Image-Restoration-using-Co-Operational-Regressor- Networks Version 1.0, Source code. [Online]. Available: https://github.com/OzerCanDevecioglu/Underwater-Image-Restoration- using-Co-Operational-Regressor-Networks
-
[27]
Underwater image enhancement via medium transmission -guided multi-color space embedding,
C. Li, S. Anwar, J. Hou, R. Cong, C. Guo, and W. Ren, “Underwater image enhancement via medium transmission -guided multi-color space embedding,” IEEE T. Image Process., vol. 30, pp. 4985–5000, 2021
2021
-
[28]
All -in-one underwater image enhancement using domain-adversarial learning
P. M. Uplavikar, Z. Wu, and Z. Wang, “All -in-one underwater image enhancement using domain-adversarial learning.” in CVPR Workshops, 2019, pp. 1–8
2019
-
[29]
Enhancing underwater imagery using generative adversarial networks,
C. Fabbri, M. J. Islam, and J. Sattar, “Enhancing underwater imagery using generative adversarial networks,” ICRA, pp. 7159–7165, 2018
2018
-
[30]
Fast underwater image enhancement for improved visual perception,
M. J. Islam, Y. Xia, and J. Sattar, “Fast underwater image enhancement for improved visual perception,” IEEE Robot. Autom. Lett., vol. 5, no. 2, pp. 3227–3234, 2020
2020
-
[31]
An underwater image enhancement benchmark dataset and beyond,
C. Li, C. Guo, W. Ren, R. Cong, J. Hou, S. Kwong, and D. Tao, “An underwater image enhancement benchmark dataset and beyond,” IEEE T. Image Process., vol. 29, pp. 4376–4389, 2020. Blind Underwater Image Restoration using Co-Operational Regressor Networks 10 APPENDIX A In this ...
2020
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.