REVIEW 3 major objections 5 minor 27 references
Contour Detection in Cassini ISS images based on Hierarchical Extreme Learning Machine and Dense Conditional Random Field
T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read The paper proposes a contour-detection pipeline for Cassini ISS images that combines a hierarchical extreme learning machine with a dense conditional random field, and reports that it outperforms SVM, plain ELM, and a comparison CNN while…
desk verdict A legitimate but incremental H-ELM+DenseCRF application for Cassini contour detection, undercut by a toy CNN baseline and an inconsistent results table. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the hierarchical extreme learning machine (H-ELM): an ELM is a single-hidden-layer network with random input weights whose output weights are solved by least squares, and H-ELM adds sparse-autoencoder layers in front of it to learn compact features without backpropagation. The paper pairs it with a dense conditional random field (DenseCRF), which models all pairs of pixels and is used as a back-end optimizer to smooth the H-ELM's pixel probabilities using image grayscale and spatial proximity. Each pixel is first encoded as a 28-dimensional vector made of nine first-order gradients, nine second-order gradients, and ten Haar-like features, so the learning task is a binary classification of pixels into contour (1) and non-contour (0). The machinery's role is to make training fast (closed-form least squares for the output weights) while the DenseCRF supplies the global consistency that removes spurious interior edges.
What would settle it
Regenerate ground truth by independent manual contour annotation on the same 200 images, then retrain the same H-ELM+DenseCRF pipeline and a stronger deep edge-detection network (for instance a deeper CNN or HED) on the same 130 training images and compare F1 on the 70 test images; if the deep network matches or exceeds 0.58 F1, or if the H-ELM advantage disappears under the new labels, the paper's central claim is unsupported.
Extended reading notes
Core claim
On its own terms, the paper's discovery is that a deliberately shallow learning pipeline can beat both classical edge detectors and a convolutional network at the specific task of extracting the outer contour of a disk-resolved body in Cassini ISS images. The authors label 200 ISS images semi-automatically by running Canny and manually correcting the result, then train a two-layer sparse-autoencoder feature extractor followed by an ELM classifier on 28 handcrafted features per pixel. After classification, DenseCRF enforces spatial consistency and removes interior contours. The reported numbers are a 0.58 average F1-measure on 70 test images, 0.66 precision, 0.54 recall, and a training time of about 9.004 seconds, against an SVM at 112.270 s, a plain ELM at 7.573 s, and a four-layer CNN at 6138.948 s. The paper concludes that the method is suitable for routine contour detection in Cassini ISS astrometry.
Load-bearing premise
The claim rests on the assumption that the semi-automatic Canny-based labels are a fair ground truth, that the 70 test images represent typical Cassini ISS conditions, and that the shallow CNN used for comparison is a fair representative of deep networks.
Editorial extensions
If this is right
- Cassini's archive of more than 400,000 images becomes practical to process for disk-resolved astrometry, since each image takes roughly 7.8 seconds on a commodity CPU after a 9-second training run.
- The DenseCRF stage cleanly removes the terminator and other interior boundaries, so the output is a single outer limb suitable for center-of-figure estimates.
- The method does not require a GPU or a large labeled corpus, which lowers the barrier for processing future planetary imaging datasets.
- The reported precision (0.66) and recall (0.54) show the detector errs toward not marking uncertain pixels, which is the favorable direction when false contour pixels would corrupt center fitting.
Reading between the lines
- If the labels are unbiased, the same 28-feature H-ELM+DenseCRF recipe should transfer to other disk-resolved solar-system bodies (e.g., Jupiter and its moons) with no architectural change, although the paper does not test this.
- The 'beats deep CNN' claim is only as strong as the comparison network: the paper's CNN uses four 3x3 convolution layers, two max-pooling layers, and 28x28 inputs, so a modern edge-detection network trained on the same data might close the gap.
- Because the training-time comparison mixes different algorithms on a single laptop CPU, the practical speed advantage could shift when implementations are optimized or run on GPUs; the paper does not report such runs.
- A direct test of astrometric value would be to measure how much the detected contours change derived satellite centers compared with manual limb fits; the paper stops at pixel-level F1.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a contour detection method for Cassini ISS images that combines a Hierarchical Extreme Learning Machine (H-ELM) with a Dense Conditional Random Field (DenseCRF) post-processing step. Each pixel is described by 28 hand-crafted features (first-order gradients, second-order gradients, and Haar-like features), classified by an H-ELM whose unsupervised layers are trained with sparse autoencoders, and the resulting probability map is refined by DenseCRF. Experiments on 130 training and 70 test ISS images (512×512, each containing one disk-resolved object) report an average F1-measure of 0.58, a training time of about 9 seconds, and a per-image testing time of about 7.8 seconds. Comparisons are made against Canny/Sobel/Roberts/Prewitt edge operators, SVM, ELM, and a CNN baseline, and the authors claim the method outperforms all of these, including 'even deep convolutional neural network'.
Significance. If the reported results are reliable, the method offers a fast and reasonably accurate contour detector for Cassini ISS images, which is relevant for astrometry and for removing false star detections inside planetary disks. The paper is transparent about the preprocessing, feature set, network structure, and hyperparameter choices, and it reports quantitative comparisons against several baselines. However, the central claim of superiority over deep convolutional neural networks is not supported by the experiments as presented: the CNN baseline is a small patch-based classifier, no error bars or statistical tests are given, and the contribution of DenseCRF is only shown qualitatively. The core H-ELM pipeline is plausible and may be useful for the intended application, but the evidence as it stands does not justify the headline claim about deep networks.
major comments (3)
- [§5.3.4, Table 3] The claim in the abstract and Section 1 that the proposed method outperforms 'even deep convolutional neural network' is not supported by the comparison reported in Table 3. The CNN baseline is a patch-based classifier that takes 28×28 image blocks as input and output, with only four 3×3 convolutional layers, two 2×2 max-pooling layers, and one fully connected layer. This is not representative of modern deep convolutional contour detectors such as HED (Xie & Tu 2017) or U-Net, which the introduction itself cites, and it also uses a different input representation (raw patches vs. 28 handcrafted features) and no post-processing. To support the claimed superiority, the authors should provide a comparison with a competitive full-image deep edge detector (or at least a properly tuned CNN on the same input representation), and report error bars so the reader can assess the significance of the difference.
- [§5.3.5 and §3] The benefit of DenseCRF post-processing is only demonstrated qualitatively in Figure 10, but it is listed as one of the method's advantages in the conclusion. Since the contribution of the CRF is a load-bearing part of the proposed pipeline, the paper should provide quantitative F1-measure, precision, and recall for H-ELM without DenseCRF on the same test set. Without this ablation, the reader cannot determine how much of the reported improvement over ELM and SVM is due to the CRF rather than to the hierarchical feature learning in H-ELM.
- [§5.2, Table 2] No error bars, standard deviations, or confidence intervals are reported for any of the performance metrics. The test set consists of only 70 images, and per-image F1 values among the nine listed examples range from 0.588 to 0.697, indicating substantial variance. Point estimates alone are insufficient to establish that the observed differences between methods are statistically meaningful, especially given the small sample and the large reported gap between the proposed method and the CNN baseline. The authors should report variance or per-image distributions for all methods.
minor comments (5)
- [Table 2] The row labeled 'Average' appears to be the mean over the full 70-image test set, but the caption says the table shows results 'in some ISS images' without specifying that the average is over all test images. The mean of the nine listed F1 values is approximately 0.626, not 0.580, which is confusing. Please clarify in the caption that the Average row covers the complete test set.
- [§2.2] The paper states that 34 candidate features were designed and 28 were selected based on 'some common senses and some experiments,' but the six omitted features are never described. Please provide the full candidate list and a more explicit feature-selection rationale so the reader can judge whether the chosen set is justified.
- [§5.1] The choice of the H-ELM architecture (three hidden layers with 200, 200, and 1000 nodes) is justified only by 'our experiments and comparative analysis' without reporting the results of that analysis. A brief parametric study or a reference to a prior evaluation would make this key design decision more reproducible.
- [Throughout] There are multiple typographical and grammatical errors that should be corrected, including 'dont' in §5.3.2, inconsistent 'Harr-like'/'Haar-like' in §2.2.3, and the reference 'Krhenbhl & Koltun' which should read 'Krähenbühl & Koltun'. A careful editing pass is needed.
- [Abstract and Conclusions] The phrase 'deep convolutional neural network' is used loosely. The CNN evaluated in §5.3.4 is a shallow patch-based classifier, not a deep full-image network. Please use precise terminology so that the claims match the actual experiments.
Circularity Check
No significant circularity; the H-ELM+DenseCRF contour detector is an empirical construction evaluated on an independent test set.
full rationale
The paper contains no derivation that reduces to its inputs. The method is a supervised pixel classifier: 28 handcrafted features (Sec. 2.2) are fed to H-ELM (Sec. 2.3), whose sparse-autoencoder layers and ELM classifier are standard constructions cited to Tang et al. (2016) and Huang et al. (2006), and DenseCRF post-processing is taken from Krähenbühl and Koltun (2012). Hyperparameters are selected by grid search on the training set (Sec. 5.1), which is ordinary model selection rather than fitting the test result. Labels are semi-automatic Canny plus manual correction (Sec. 4.1); although Canny-derived labels could bias the comparison with Canny, the manual correction and the evaluation on held-out images make this an evaluation-design concern, not circularity. The citation of Yang et al. 2018 as "our previous research" is a self-citation, but it is used only as motivation for the method family, and no load-bearing claim depends on it; H-ELM and DenseCRF are introduced and cited to their original external sources. The concern that the CNN baseline is unrepresentative (four 3x3 convolution layers, 28x28 patches, no CRF, Table 3) is a correctness and fairness critique of the empirical comparison, not circularity under the definition used here. Accordingly, no circular step is identified.
Assumptions & free parameters
free parameters (4)
- Regularization factor C =
2^18
- Number of hidden layers and nodes =
3 layers: 200, 200, 1000 nodes
- Under-sampling ratio =
1:4 positive to negative
- Feature set size =
28 of 34 candidate features
assumptions (5)
- domain assumption ELM with random input weights and least-squares output weights is a valid classifier
- domain assumption H-ELM with sparse autoencoders improves feature learning
- domain assumption DenseCRF can optimize pixel labels using image gray-level information
- ad hoc to paper The 28 hand-crafted features are sufficient for contour classification
- domain assumption The training labels (Canny plus manual correction) are accurate ground truth
Cite this review
Pith. "Pith review of Contour Detection in Cassini ISS images based on Hierarchical Extreme Learning Machine and Dense Conditional Random Field." pith.science (2026). https://pith.science/paper/VPUWDR6P
@misc{pith2026190808279,
author = {Pith},
title = {Pith review of: Contour Detection in Cassini ISS images based on Hierarchical Extreme Learning Machine and Dense Conditional Random Field},
year = {2026},
howpublished = {\url{https://pith.science/paper/VPUWDR6P}},
note = {Machine review of arXiv:1908.08279}
}
read the original abstract
In Cassini ISS (Imaging Science Subsystem) images, contour detection is often performed on disk-resolved object to accurately locate their center. Thus, the contour detection is a key problem. Traditional edge detection methods, such as Canny and Roberts, often extract the contour with too much interior details and noise. Although the deep convolutional neural network has been applied successfully in many image tasks, such as classification and object detection, it needs more time and computer resources. In the paper, a contour detection algorithm based on H-ELM (Hierarchical Extreme Learning Machine) and DenseCRF (Dense Conditional Random Field) is proposed for Cassini ISS images. The experimental results show that this algorithm's performance is better than both traditional machine learning methods such as SVM, ELM and even deep convolutional neural network. And the extracted contour is closer to the actual contour. Moreover, it can be trained and tested quickly on the general configuration of PC, so can be applied to contour detection for Cassini ISS images.
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
-
[1]
2011, IEEE t ransactions on pattern analysis and machine intelligence, 33, 898 2, 8
Arbelaez, P ., Maire, M., Fowlkes, C., & Malik, J. 2011, IEEE t ransactions on pattern analysis and machine intelligence, 33, 898 2, 8
work page 2011
-
[2]
Barandela, R., V aldovinos, R. M., Snchez, J. S., & Ferri, F. J. 2004, Lecture Notes in Computer Science, 3138, 806 7
work page 2004
-
[3]
Chawla, N. V ., Bowyer, K. W ., Hall, L. O., & Kegelmeyer, W . P . 2002, Journal of Artificial Intelligence Research, 16, 321 7
work page 2002
-
[4]
Cooper, N. J., Murray, C. D., Lainey, V ., et al. 2014, A&A, 572, A43 1
work page 2014
-
[5]
2012, Journal o f Geophysical Research, 117, E07005 2
Cornet, T., Bourgeois, O., Moulic, S., et al. 2012, Journal o f Geophysical Research, 117, E07005 2
work page 2012
-
[6]
2005, IEEE Conference on Computer Vis ion and Pattern Recognition (CVPR 2005), 1, 886 2
Dalal, N., & Triggs, B. 2005, IEEE Conference on Computer Vis ion and Pattern Recognition (CVPR 2005), 1, 886 2
work page 2005
- [7]
-
[8]
2013, IEEE t ransactions on pattern analysis and machine intelligence, 35, 1915 2
Farabet, C., Couprie, C., Najman, L., & Lecun, Y . 2013, IEEE t ransactions on pattern analysis and machine intelligence, 35, 1915 2
work page 2013
Show all 27 references
-
[9]
2006, Neurocomputing, 70, 489 4
Huang, G., Zhu, Q., & Siew, C. 2006, Neurocomputing, 70, 489 4
2006
-
[10]
Y uille, A., Coughlan, J., & Zhu, S
Konishi, S., L. Y uille, A., Coughlan, J., & Zhu, S. 2003, Patt ern Analysis and Machine Intelligence, IEEE Transactions on, 25, 57 2
2003
-
[11]
2012, Adv
Krhenbhl, P ., & Koltun, V . 2012, Adv. Neural Inf. Process. Syst., 24, 109 6
2012
-
[12]
2002, Proc ICML, 28 2 6
Lafferty, J., Mccallum, A., & Pereira, F. 2002, Proc ICML, 28 2 6
2002
-
[13]
2002, in , 900 4
Lienhart, R., & Maydt, J. 2002, in , 900 4
2002
-
[14]
2018, Research in Astronomy and Astrophysics, 18, 022 1
Liu, B., Y u, J.-Z., & Peng, Q.-Y . 2018, Research in Astronomy and Astrophysics, 18, 022 1
2018
-
[15]
2015, PloS one, 10, e0134254 4
Mcdonnell, M., Tissera, M., Vladusich, T., van Schaik, A., & Tapson, J. 2015, PloS one, 10, e0134254 4
2015
-
[16]
Minhas, R., Baradarani, A., Seifzadeh, S., & Wu, Q. M. J. 2010 , Neurocomputing, 73, 1906 4
2010
-
[17]
2017, Research in Astronomy and Astrophysics, 17, 21 1 R Martin, D., C Fowlkes, C., & Malik, J
Peng, H.-W ., Peng, Q.-Y ., & Wang, N. 2017, Research in Astronomy and Astrophysics, 17, 21 1 R Martin, D., C Fowlkes, C., & Malik, J. 2004, IEEE transactio ns on pattern analysis and machine intelligence, 26, 530 2, 8
2017
-
[18]
M., Upadhyaya, T
Saheba, S. M., Upadhyaya, T. K., & Sharma, R. K. 2016, IET Imag e Processing, 10, 657 2
2016
-
[19]
Cooper, N., Lainey, V ., Charnoz, S., & D
Tajeddine, R., J. Cooper, N., Lainey, V ., Charnoz, S., & D. Mu rray, C. 2013, Astronomy and Astrophysics, 551, 129 1
2013
-
[20]
2015, Astronomy and Astrophysics, 575 1
Tajeddine, R., Lainey, V ., Cooper, N., & Murray, C. 2015, Astronomy and Astrophysics, 575 1
2015
-
[21]
2016, IEEE Transactions on Neu ral Networks and Learning Systems, 27, 809 6
Tang, J., Deng, C., & Huang, G. 2016, IEEE Transactions on Neu ral Networks and Learning Systems, 27, 809 6
2016
-
[22]
2015, Geoscience and Remote Sensing, IEEE Transactions on, 53, 1174 4 V apnik, V
Tang, J., Deng, C., Huang, G., & Zhao, B. 2015, Geoscience and Remote Sensing, IEEE Transactions on, 53, 1174 4 V apnik, V . 1998, Statistical Learning Theory, V ol. 108
2015
-
[23]
2001, in , I 4
Viola, P ., & Jones, M. 2001, in , I 4
2001
-
[24]
2004, International Journal of Computer Vision, 57, 137 4
Viola, P ., & Jones, M. 2004, International Journal of Computer Vision, 57, 137 4
2004
-
[25]
2017, International Journal of Computer Vis ion, 125, 1 2 Y ang, X., Zhang, Q., Y ang, X., et al
Xie, S., & Tu, Z. 2017, International Journal of Computer Vis ion, 125, 1 2 Y ang, X., Zhang, Q., Y ang, X., et al. 2018, MA TEC Web of Conferences, 189, 06007 2
2017
-
[26]
2018, Monthly Notices of the Royal Astronomical Society, 481, 98 1
Zhang, Q., Lainey, V ., Cooper, N., et al. 2018, Monthly Notices of the Royal Astronomical Society, 481, 98 1
2018
-
[27]
2019, Sci Sin-Phys Mech Astron, 49, 019502 1
Zhang, Q., Xiong, Y ., Peng, Q., et al. 2019, Sci Sin-Phys Mech Astron, 49, 019502 1
2019
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.