Pith. sign in

REVIEW 3 major objections 4 minor 23 references

Comparative Analysis of Machine Learning and Deep Learning Models for Classifying Squamous Epithelial Cells of the Cervix

T0 review · 3 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read ResNet-50 outperforms classical ML on cervical smear cells at 93%

desk verdict A routine SIPaKMeD benchmark whose headline ResNet-50 accuracy is likely inflated by image-level random splitting that ignores the 966-cluster structure; fixable but not publishable as is. read the letter →

arxiv 2411.13535 v1 pith:IDCGE7DP submitted 2024-11-20 eess.IV cs.CV

Subhasish Das , Satish K Panda , Madhusmita Sethy , Prajna Paramita Giri , Ashwini K Nanda This is my paper · ORCID
classification eess.IVcs.CV
keywords cervicalcancerPapsmearsquamousepithelialcellsResNet-50deeplearningmachineHOGfeaturescellclassification
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tests whether machine learning or deep learning is better at sorting cervical cells in Pap smear images into five categories: superficial-intermediate, parabasal, koilocytes, dyskeratotic, and metaplastic. Using the SIPaKMeD dataset of 4,049 cropped cell images, the authors compare handcrafted-feature classifiers (SVM, k-nearest neighbors, random forest, gradient boosting variants) against a fine-tuned ResNet-50. The central claim is that ResNet-50 reaches 93.06% test accuracy, far above the best machine-learning result of 70.64% (SVM), with per-class accuracies from 85.98% to 98.89%. The authors argue this supports deep learning as the practical choice for automated cervical cytology screening and early cervical cancer diagnosis.

What carries the argument

The argument runs on two pipelines. For machine learning, the central object is the Histogram of Oriented Gradients (HOG) descriptor, which converts each cell image into a histogram of local gradient orientations that captures shape, edge direction, and texture; those feature vectors are fed into random forest, gradient boosting, XGBoost, CatBoost, k-nearest neighbors, and support vector machine classifiers. For deep learning, the central object is ResNet-50, a 50-layer convolutional neural network whose residual blocks use shortcut connections to skip layers and learn residual functions, easing the vanishing-gradient problem and enabling deeper training. The network's final layer is replaced with a five-output linear layer, weights are initialized from ImageNet pretraining, and training runs for 500 epochs with the Adam optimizer, a batch size of 32, and augmentations such as flipping, noise, and contrast changes. The data is split 8:1:1 into training, validation, and test sets.

What would settle it

Re-run the same ResNet-50 training with an 8:1:1 split performed at the level of the 966 cell clusters rather than the 4,049 individual images; if the test accuracy falls well below 93.06%, the headline number reflects image leakage rather than generalization to new cervical samples.

Watch

Extended reading notes

Core claim

The paper's central discovery is that a ResNet-50 convolutional network fine-tuned on Pap smear cell images classifies five cervical squamous epithelial cell types with 93.06% accuracy, outperforming every handcrafted-feature machine-learning model tested. Among the classical models, the support vector machine was the best at 70.64%, while random forest, gradient boosting, XGBoost, CatBoost, and k-nearest neighbors all landed below 59%. The ResNet-50 model, trained for 500 epochs with ImageNet-pretrained weights and data augmentation, reached 98.89% accuracy on parabasal cells, 95.83% on superficial-intermediate cells, 93.27% on dyskeratotic cells, 92.52% on metaplastic cells, and 85.98% on koilocytes. The authors conclude that deep learning is the more reliable route for cell-level classification in automated cervical cancer screening, despite its higher computational cost.

Load-bearing premise

The 8:1:1 split treats each of the 4,049 cropped cell images as an independent sample, but the images were cropped from only 966 cell clusters, so if images from one cluster land in both training and test sets the 93.06% accuracy overstates how well the model would generalize to a new patient or slide.

Editorial extensions

If this is right

  • If 93.06% accuracy holds up, an automated ResNet-50-based screener could flag abnormal cervical cells from Pap smear images at a level of agreement that manual review struggles to match at scale.
  • Deep learning would be the preferred approach for clinical deployment because, as the paper notes, accuracy matters for clinical acceptance even when training is computationally expensive.
  • The classical machine-learning models, though cheap to train, would be too inaccurate for screening use, supporting a shift toward convolutional networks in cervical cytology.
  • Per-class results suggest that koilocytes, the HPV pathognomonic cells, are the hardest to recognize (85.98%), pointing future work at improving that category.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The 8:1:1 split was made on the 4,049 individual images, but those images were cropped from only 966 cell clusters; if images from the same cluster appear in both training and test sets, the reported accuracy overstates how the model would perform on a new patient or slide. A cluster-level split would be the stricter test.
  • Because the test set shares the same staining, microscope, and acquisition setup as the training set, the model's accuracy on images from other labs or preparation protocols is an open question that the paper does not address.
  • The comparison could be sharpened by reporting precision, recall, and F1-score per class alongside accuracy, since the five classes are imbalanced and accuracy alone may hide systematic confusions.
  • Fine-tuning on a larger, multi-center cervical cytology dataset would show whether the ResNet-50 advantage persists when variability in staining and cell morphology is higher.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. This paper compares traditional machine learning (Random Forest, Gradient Boosting, kNN, SVM with HOG features) and a deep learning model (ResNet-50) for classifying cervical squamous epithelial cells into five categories using the public SIPaKMeD dataset. The authors report that ResNet-50 achieves the highest test accuracy of 93.06%, outperforming the best ML model (SVM, 70.64%). They conclude that deep learning is more suitable for cell-level classification and could aid early cervical cancer diagnosis from Pap smear images.

Significance. If the reported result holds, the paper is a modest empirical benchmark confirming that fine-tuned deep networks outperform handcrafted-feature ML models on a standard public dataset. The use of a public dataset and the inclusion of both ML and DL baselines are positives, and the class-wise accuracies are useful for comparison. However, the central accuracy figure currently rests on a single random image-level split of images that are known to be non-independent due to cluster structure, and the lack of statistical or reproducibility details prevents the reader from assessing the reliability and generalizability of the claimed superiority.

major comments (3)
  1. [§2.1 and §2.2] Section 2.1 states that the 4,049 cell images were manually cropped from 966 clusters, while Section 2.2 describes only an 8:1:1 random split into train, validation, and test sets with no cluster-level grouping. Because images from the same cluster share acquisition conditions, staining, and often similar morphology, a random image-level split is likely to place sibling crops from the same cluster into both training and test sets. This can artificially inflate the reported 93.06% accuracy and the comparison between models, since the model may exploit cluster-specific appearance rather than learn generalizable cell categories. The central claim of the paper depends on performance on unseen slides, so the authors must re-run all experiments with a cluster-stratified split (e.g., splitting at the level of the 966 original clusters) and report both the accuracy and the number of clusters that span the split boundaries.
  2. [§3, Table 2] All accuracies in Table 2 are single point estimates from one random split. The test set contains only about 405 images, so the reported differences between models are accompanied by considerable sampling variability, yet no confidence intervals, standard deviations, or repeated runs with different seeds are provided. The claim that ResNet-50 'outperformed' the ML models would be more credible if the authors reported the mean and standard deviation of accuracy over multiple independent splits, or at least a bootstrap confidence interval, to show that the ranking is stable.
  3. [§2.2] The training and evaluation protocol is under-specified, which prevents reproducibility of the comparative analysis. For ResNet-50, the authors give the optimizer, learning rate, batch size, and epoch count, but the data augmentation operations (flipping, noise addition, contrast change) are listed without magnitudes or probabilities, and it is unclear whether the entire network is fine-tuned or only the final linear layer is trained ('feature extraction' is ambiguous). For the ML models, the HOG parameters (cell size, block size, number of orientations) and classifier hyperparameters (e.g., SVM kernel and C, k for kNN, number of trees for Random Forest, boosting hyperparameters for Gradient Boosting/XGBoost/CatBoost) are not reported. Without these settings, the comparison cannot be reproduced or independently verified.
minor comments (4)
  1. [Table 2] The row numbering is inconsistent: two rows are labeled '2' (Scikit-learn Gradient Boost and XGBoost). Also, XGBoost and CatBoost appear in the results but are not described in the Methods section.
  2. [Figure 4] The confusion matrix and ROC curves would benefit from axis labels and a legend; the current figure is difficult to read because the class names are only given in the caption, not on the axes.
  3. [§2.2] The phrase 'ImageNet pre-trained weights for feature extraction' is ambiguous: clarify whether the convolutional backbone was frozen or fine-tuned. This materially affects the interpretation of the 500-epoch training procedure.
  4. [References] The HOG feature extraction is cited to a vehicle-detection paper [21]; a more standard and complete description, such as the original Dalal and Triggs reference, would be more appropriate for this widely used method.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: the accuracy claims are empirical benchmark results from a held-out test set, not derivations from the inputs.

full rationale

This paper is an empirical benchmark study, not a derivation or a first-principles prediction. The central claim (ResNet-50 achieves 93.06% test accuracy and outperforms the machine-learning baselines) is obtained by training classifiers on a training subset and evaluating them on a held-out test subset. No parameter is fitted to the test labels, no quantity is defined in terms of the quantity it is said to predict, and no load-bearing argument reduces to a self-citation. The paper cites standard algorithm references and the SIPaKMeD dataset, but it does not invoke any prior work by the same authors to justify a premise. The abstract and results report a single empirical accuracy figure, which is the outcome of the experiment rather than an input. The dataset-dependence and the image-level random split described in Section 2.2 ("We split the dataset into three categories, i.e., train, validate, and test sets, in the proportion of 8:1:1") raise a possible generalization concern about cluster-level leakage, since the images were cropped from 966 cell clusters per Section 2.1, but that is a validity threat about experimental design, not circular reasoning: the reported accuracy is still a measured value, not one that is true by construction or by the paper's own definitions. Under the stated review rules, a non-finding is the appropriate verdict because no specific reduction of the paper's claim to its inputs can be exhibited.

Assumptions & free parameters 5 free parameters · 3 assumptions · 0 invented entities

The central claim of 93.06% accuracy rests on the data split being independent and on a long list of unreported hyperparameter choices. No theoretical derivation is present, so the paper's contribution is an empirical comparison whose validity depends on these assumptions.

free parameters (5)
  • HOG feature extraction parameters = Not reported
    The paper says HOG features were extracted following Putra et al., but does not state the number of orientations, pixels per cell, or cells per block. These choices affect the ML accuracy.
  • ML hyperparameters = Not reported
    For Random Forest, Gradient Boosting, XGBoost, CatBoost, kNN, and SVM, the paper gives no hyperparameter values (e.g., number of trees, learning rate, C, kernel, k). The reported accuracies depend on these settings.
  • Train/validation/test split ratio = 8:1:1 random split
    The split is chosen by the authors; because the dataset has images cropped from clusters, the random split may not ensure independence. This choice directly affects the test accuracy.
  • Data augmentation operations = resizing, center cropping, flipping, noise, contrast change
    The augmentation policy is described only by a list; the exact parameters (noise level, contrast factor, etc.) are not given, and they influence generalization.
  • ResNet-50 training hyperparameters = 500 epochs, batch size 32, Adam lr 0.001, ImageNet init
    These are stated; they are standard but the choice of 500 epochs without early stopping or learning rate schedule may affect the final accuracy.
assumptions (3)
  • domain assumption The SIPaKMeD ground-truth labels are correct and each image belongs to exactly one of the five cell categories.
    Used throughout the supervised training in Section 2.2 and evaluation in Section 3.
  • domain assumption Randomly splitting images 8:1:1 yields independent training and test sets, i.e., no information leakage through shared cell clusters.
    Invoked in Section 2.2 when the dataset is split; the dataset description in Section 2.1 states images are cropped from 966 clusters, which undermines this assumption.
  • domain assumption The standard algorithm implementations (scikit-learn, XGBoost, CatBoost, PyTorch) behave as expected with default or unspecified parameters.
    The paper relies on these libraries without version numbers or custom code.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Comparative Analysis of Machine Learning and Deep Learning Models for Classifying Squamous Epithelial Cells of the Cervix." pith.science (2026). https://pith.science/paper/IDCGE7DP

@misc{pith2026241113535,
  author       = {Pith},
  title        = {Pith review of: Comparative Analysis of Machine Learning and Deep Learning Models for Classifying Squamous Epithelial Cells of the Cervix},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/IDCGE7DP}},
  note         = {Machine review of arXiv:2411.13535}
}
read the original abstract

The cervix is the narrow end of the uterus that connects to the vagina in the female reproductive system. Abnormal cell growth in the squamous epithelial lining of the cervix leads to cervical cancer in females. A Pap smear is a diagnostic procedure used to detect cervical cancer by gently collecting cells from the surface of the cervix with a small brush and analyzing their changes under a microscope. For population-based cervical cancer screening, visual inspection with acetic acid is a cost-effective method with high sensitivity. However, Pap smears are also suitable for mass screening due to their higher specificity. The current Pap smear analysis method is manual, time-consuming, labor-intensive, and prone to human error. Therefore, an artificial intelligence (AI)-based approach for automatic cell classification is needed. In this study, we aimed to classify cells in Pap smear images into five categories: superficial-intermediate, parabasal, koilocytes, dyskeratotic, and metaplastic. Various machine learning (ML) algorithms, including Gradient Boosting, Random Forest, Support Vector Machine, and k-Nearest Neighbor, as well as deep learning (DL) approaches like ResNet-50, were employed for this classification task. The ML models demonstrated high classification accuracy; however, ResNet-50 outperformed the others, achieving a classification accuracy of 93.06%. This study highlights the efficiency of DL models for cell-level classification and their potential to aid in the early diagnosis of cervical cancer from Pap smear images.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

23 extracted references · 20 canonical work pages

  1. [1]

    A., Jhingran, A., Oaknin, A., & Denny, L

    Cohen, P. A., Jhingran, A., Oaknin, A., & Denny, L. (2019). Cervical cancer. The Lancet, 393(10167), 169-182

    work page 2019

  2. [2]

    Mehta, V ., Vasanth, V ., & Balachandran, C. (2009). Pap smear. Indian journal of dermatology, venereology and leprology, 75, 214

    work page 2009

  3. [3]

    E., Dimitrakopoulos, P., Sfikas, G., Nikou, C., Krikoni, O., & Charchanti, A

    Plissiti, M. E., Dimitrakopoulos, P., Sfikas, G., Nikou, C., Krikoni, O., & Charchanti, A. (2018, October). Sipakmed: A new dataset for feature and image based classification of normal and pathological cervical cells in pap smear images. In 2018 25th IEEE internat ional conference on image processing (ICIP) (pp. 3144-3148). IEEE

    work page 2018

  4. [4]

    Rigatti, S. J. (2017). Random forest. Journal of Insurance Medicine, 47(1), 31-39

    work page 2017

  5. [5]

    Natekin, A., & Knoll, A. (2013). Gradient boosting machines, a tutorial. Frontiers in neurorobotics, 7, 21

    work page 2013

  6. [6]

    Guo, G., Wang, H., Bell, D., Bi, Y ., & Greer, K. (2003). KNN model -based approach in classification. In On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE: OTM Confederated International Conferences, CoopIS, DOA, and ODBASE 2003, Catania, Sicily, Italy, November 3 -7, 2003. Proceedings (pp. 986 -996). Springer Berlin Heidelberg

    work page 2003

  7. [7]

    Jakkula, V . (2006). Tutorial on support vector machine (svm). School of EECS, Washington State University, 37(2.5), 3

    work page 2006

  8. [8]

    Koonce, B., & Koonce, B. E. (2021). Convolutional neural networks with swift for tensorflow: Image recognition and dataset categorization (pp. 109-123). New York, NY , USA: Apress

    work page 2021

Show all 23 references
  1. [9]

    M., Patrick, R

    Shingleton, H. M., Patrick, R. L., Johnston, W. W., & Smith, R. A. (1995). The current status of the Papanicolaou smear. CA: a cancer journal for clinicians, 45(5), 305-320

    1995

  2. [10]

    Affonso, C., Rossi, A. L. D., Vieira, F. H. A., & de Leon Ferreira, A. C. P. (2017). Deep learning for biological image classification. Expert systems with applications, 85, 114-122

    2017

  3. [11]

    N., & Abuhammad, H

    Abuzaid, N. N., & Abuhammad, H. Z. (2022). Image SPAM Detection Using ML and DL Techniques. International Journal of Advances in Soft Computing & Its Applications, 14(1)

    2022

  4. [12]

    LeCun, Y ., Bengio, Y ., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444

    2015

  5. [13]

    Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25. 15

    2012

  6. [14]

    Rawat, W., & Wang, Z. (2017). Deep convolutional neural networks for image classification: A comprehensive review. Neural computation, 29(9), 2352-2449

    2017

  7. [15]

    K., Duin, R

    Jain, A. K., Duin, R. P. W., & Mao, J. (2000). Statistical pattern recognition: A review. IEEE Transactions on pattern analysis and machine intelligence, 22(1), 4-37

    2000

  8. [16]

    (2016, August)

    Chen, T., & Guestrin, C. (2016, August). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785-794)

    2016

  9. [17]

    V ., & Gulin, A

    Prokhorenkova, L., Gusev, G., V orobev, A., Dorogush, A. V ., & Gulin, A. (2018). CatBoost: unbiased boosting with categorical features. Advances in neural information processing systems, 31

    2018

  10. [18]

    Fawcett, T. (2006). An introduction to ROC analysis. Pattern recognition letters, 27(8), 861- 874

    2006

  11. [19]

    J., & Till, R

    Hand, D. J., & Till, R. J. (2001). A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine learning, 45, 171-186

    2001

  12. [20]

    Sokolova, M., & Lapalme, G. (2009). A systematic analysis of performance measures for classification tasks. Information processing & management, 45(4), 427-437

    2009

  13. [21]

    Putra, F. A. I. A., Utaminingrum, F., & Mahmudy, W. F. (2020). HOG feature extraction and KNN classification for detecting vehicle in the highway. IJCCS (Indonesian Journal of Computing and Cybernetics Systems), 14(3), 231-242

    2020

  14. [22]

    B., Kundu, M

    Bora, K., Chowdhury, M., Mahanta, L. B., Kundu, M. K., & Das, A. K. (2016, December). Pap smear image classification using convolutional neural network. In Proceedings of the tenth Indian conference on computer vision, graphics and image processing (pp. 1-8)

    2016

  15. [23]

    M., Sun, H.,

    Liu, W., Li, C., Xu, N., Jiang, T., Rahaman, M. M., Sun, H., ... & Grzegorzek, M. (2022). CVM-Cervix: A hybrid cervical Pap-smear image classification framework using CNN, visual transformer and multilayer perceptron. Pattern Recognition, 130, 108829

    2022

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.