Pith. sign in

REVIEW 4 major objections 6 minor 1 cited by

Electrocardiogram (ECG) Based Cardiac Arrhythmia Detection and Classification using Machine Learning Algorithms

T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper's central claim is that a 1D convolutional neural network trained on individual ECG heartbeats classifies five arrhythmia types with 98.66–99.24% accuracy under stratified 5-fold cross-validation.

desk verdict The reported 98-99% accuracy is likely inflated by resampling-before-split and beat-level cross-validation; otherwise a standard, clearly written ECG classification study. read the letter →

arxiv 2412.05583 v2 pith:CB2AGNMX submitted 2024-12-07 cs.LG cs.AIeess.IV

Atit Pokharel , Shashank Dahal , Pratik Sapkota , Bhupendra Bimal Chhetri This is my paper · ORCID
classification cs.LGcs.AIeess.IV
keywords Electrocardiogram(ECG)CardiacarrhythmiaMachinelearningBidirectionalLSTMConvolutionalNeuralNetworkStratifiedcross-validationClassificationaccuracyAtrialfibrillationdetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that a comparatively simple 1D convolutional neural network, trained on individual ECG heartbeats, can tell apart normal beats and four common arrhythmia types with near-perfect accuracy. It reports 98.66% to 99.24% accuracy across the five folds of a stratified cross-validation, with per-class precision, recall, and F1 scores all near or above 0.98. The motivation is practical: reliable automatic arrhythmia detection could support remote monitoring, assistive diagnosis, and early warning before serious cardiac events. The paper also argues, from a survey of medical professionals, that such tools are welcome in clinical practice if false negatives are minimized.

What carries the argument

The mechanism that carries the argument is the 1D-CNN beat classifier plus the validation protocol around it. Heartbeats are extracted from the raw ECG using sym4 wavelet detection, z-score normalized, and fed as one-dimensional signals through three convolutional blocks (kernel sizes 7, 5, 3; filters 32, 64, 128) with batch normalization and pooling, then dropout-regularized fully connected layers and a softmax output. Stratified 5-fold cross-validation ensures every beat is used once for testing, and per-class resampling to 8000 beats makes the training set balanced. For the binary branch, a Bi-LSTM with 100 hidden units over extracted morphological features (heart rate, R-R intervals, spectral entropy, instantaneous frequency) is the mechanism.

What would settle it

Run the identical 1D-CNN pipeline with a patient-disjoint 5-fold split—ensuring no beats from the same recording appear in both training and test folds—and compare accuracy; if the 98.66–99.24% range collapses, the original cross-patient generalization claim is refuted. Additionally, check for duplicated beats introduced by the resampling step: any duplicate crossing a fold boundary would inflate the metric.

Watch

Extended reading notes

Core claim

The central discovery, stated as the authors would state it, is that a relatively shallow 1D-CNN can classify five ECG beat types—normal, left and right bundle branch block beats, premature ventricular contraction, and premature atrial contraction—with a maximum fold accuracy of 99.24% and a minimum of 98.66% after each class is resampled to 8000 beats. Combined fold confusion matrices show class-wise precision between roughly 0.977 and 0.996 and specificity above 0.994. In the earlier binary stage, a bidirectional LSTM distinguished normal from atrial-fibrillation signals with 92.44% testing accuracy and outperformed decision tree, naïve Bayes, and plain neural network classifiers, which the paper takes as evidence that sequence models fit ECG time series well.

Load-bearing premise

Everything rests on treating balanced, individual heartbeats as independent samples; if the same patient's beats appear in both training and testing folds, the 98–99% accuracies are not a measure of how the model would perform on a new patient.

Editorial extensions

If this is right

  • A heartbeat-level 1D-CNN can serve as the core of a five-class arrhythmia screener with per-class F1 scores near 0.98, because the model itself does the feature extraction from raw beat morphology.
  • The stable folds imply that the reported accuracy is not an artifact of one lucky split; every fold stays above 98.6% after class balancing.
  • The binary Bi-LSTM result means one model can reliably separate normal rhythm from atrial fibrillation before escalation to multi-class analysis.
  • The clinician survey and web portal suggest the model family is ready to be embedded in a real-time or near-real-time assistive tool, not just an offline benchmark.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the dataset is resampled to equal class sizes before the stratified split, the reported 98–99% accuracy is a class-balanced number, not a prevalence-weighted one; a deployment tool would need recalibration to real-world arrhythmia rates.
  • The per-beat split treats consecutive beats from one patient as independent, so the figures likely overstate cross-patient generalization; a per-patient split would likely be lower.
  • A natural stress test is to run the same architecture on noise-contaminated leads or on recordings from different ECG hardware; the sym4 wavelet preprocessing may not transfer cleanly to wearable-grade signals.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper develops and evaluates machine learning models for ECG-based arrhythmia detection and classification. It first presents a binary Bi-LSTM classifier distinguishing normal rhythm from atrial fibrillation using the PhysioNet Challenge 2017 dataset, reporting 92.44% test accuracy. It then describes a 1D-CNN for five-class classification (normal, LBBB, RBBB, PAC, PVC) using the MIT-BIH arrhythmia dataset, with stratified 5-fold cross-validation and reported accuracy between 98.66% and 99.24%. The paper also includes a survey of medical professionals on the utility of such systems and a locally deployed web portal for real-time demonstration. The central claim is that the 1D-CNN achieves near-perfect multiclass accuracy, indicating robust generalization.

Significance. If the reported accuracies were valid, the work would provide a useful confirmation that deep learning can classify common arrhythmia types from ECG beats, and the clinician survey adds a user-oriented perspective. The paper uses standard public datasets, gives a clear architecture description, and reports per-class precision, recall, and F1. However, the evaluation protocol has a fundamental leakage problem that invalidates the headline accuracy as an estimate of performance on new patients. The survey and web portal are minor contributions, and the multiclass result is not supported by the experiments as designed.

major comments (4)
  1. [Section III (Training and Testing Dataset)] The evaluation protocol is invalid for estimating generalization. The MIT-BIH dataset is resampled to 8000 beats per class before the stratified 5-fold split, and the split is performed at the beat level without grouping by patient. This causes two leakage paths: (i) resampling before the split can place duplicated or synthesized copies of the same minority-class beat in both training and test folds, and (ii) beats from the same patient appear in both training and test sets, allowing the CNN to memorize patient-specific QRS morphology. Consequently, the 98.66-99.24% accuracy reported in Section IV-B does not reflect performance on new patients, and the paper's central claim is unsupported.
  2. [Table I (Class A row)] The reported F1-score for class A is internally inconsistent: with precision 0.9867 and recall 0.9800, the F1-score is approximately 0.9833, not the reported 0.9933. This arithmetic inconsistency suggests that the metric table has not been carefully verified, further undermining confidence in the numerical claims.
  3. [Section IV-C (Scope and Limitations)] The limitations discussion addresses demographic transfer and computational cost but omits the train/test leakage caused by pre-split resampling and beat-level splitting. This omission is significant because the leakage is a more basic threat to validity than the issues discussed; the authors should have acknowledged and addressed it before claiming robust cross-validated performance.
  4. [Section II and III (Binary classification)] The same methodological issue affects the binary Bi-LSTM experiment: the PhysioNet 2017 dataset is resampled before the 9:1 train/test split, and the split is not patient-wise. The reported 92.44% test accuracy is therefore also likely optimistic, although this is a secondary claim relative to the multiclass result.
minor comments (6)
  1. [Affiliations] The affiliation contains the typo 'Electtionics' instead of 'Electronics'.
  2. [Section I] The word 'survelogical' appears to be a typo; likely 'survey' or 'survey-based' was intended.
  3. [Reference [4]] The reference title contains the typo 'Identication' instead of 'Identification'.
  4. [Section III (Resampling)] The resampling technique is not specified beyond 'resampling techniques'; the authors should state whether random oversampling, SMOTE, or another method was used, as this affects the leakage assessment.
  5. [Section IV-B and Table I] The cross-validation results are reported only as a range for accuracy; the paper does not report the standard deviation or per-fold class-wise metrics, making it difficult to assess stability.
  6. [Section II (Survey)] The survey section does not report the number of respondents, their specialty distribution, or the exact questions, which limits the reproducibility and interpretability of the 'medical professional opinion' results.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: the CNN accuracy results are empirical cross-validated measurements, not reductions to fitted inputs or self-citation chains.

full rationale

I reviewed the paper's derivation chain from dataset construction (Section III) through model training and evaluation (Sections II and IV). The central claim is an empirical one: a 1D-CNN trained on MIT-BIH beat waveforms achieves 98.66-99.24% accuracy under stratified 5-fold cross-validation. This claim is not derived from any fitted parameter that is then renamed as a prediction, nor does any equation make the reported accuracy equal to an input by construction. The model is trained with a standard optimizer and evaluated on held-out folds, so the reported metrics have independent empirical content. The paper contains no self-citations that carry a load-bearing argument, no imported uniqueness theorem, and no ansatz smuggled in through citation. The datasets and tools are external (PhysioNet, MIT-BIH, TensorFlow, Keras), so the benchmark is self-contained against outside data. A methodological concern exists: Section III resamples the full dataset before the stratified split and splits beats rather than patients, which may allow leakage and inflate accuracy; but leakage is an external-validity threat, not a circularity. The accuracy is not forced to equal the training distribution by definition. Under the specified taxonomy, there is no circular step.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The central claim rests on a small set of hand-picked hyperparameters and on two domain assumptions about ECG labels and wavelet features. The most serious issue is the ad hoc assumption that resampling before splitting and treating beats as independent yields valid generalization estimates; this is a known source of bias.

free parameters (5)
  • Resampling target per class (MIT-BIH) = 8000 beats per class
    Chosen by hand to balance the dataset before cross-validation; this affects class distribution and can introduce leakage.
  • Bi-LSTM hidden units = 100
    Chosen without stated search; standard choice for time-series classification.
  • CNN kernel sizes = 7, 5, 3
    Hand-picked hierarchical filter sizes; no ablation or optimization reported.
  • CNN filter counts = 32, 64, 128
    Hand-picked; no ablation or optimization reported.
  • ECG signal length (binary) = 30 seconds
    Standardized to 30 s by truncation; choice affects feature extraction.
assumptions (4)
  • domain assumption ECG annotations in PhysioNet 2017 and MIT-BIH are correct ground truth
    The paper relies on these labels to train and evaluate without external validation.
  • domain assumption Wavelet (sym4) feature extraction preserves diagnostic information
    Used for QRS detection and PQRST extraction; no validation that these features retain all relevant morphology.
  • ad hoc to paper Resampling before cross-validation gives an unbiased estimate of model performance
    This assumption is specific to the paper's setup and is not standard practice; it actually violates independence in cross-validation.
  • ad hoc to paper Individual beats can be treated as independent samples
    The paper splits beats without grouping by patient, assuming no between-beat correlation; this is false in practice and inflates accuracy.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Electrocardiogram (ECG) Based Cardiac Arrhythmia Detection and Classification using Machine Learning Algorithms." pith.science (2026). https://pith.science/paper/CB2AGNMX

@misc{pith2026241205583,
  author       = {Pith},
  title        = {Pith review of: Electrocardiogram (ECG) Based Cardiac Arrhythmia Detection and Classification using Machine Learning Algorithms},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CB2AGNMX}},
  note         = {Machine review of arXiv:2412.05583}
}
read the original abstract

The rapid advancements in Artificial Intelligence, specifically Machine Learning (ML) and Deep Learning (DL), have opened new prospects in medical sciences for improved diagnosis, prognosis, and treatment of severe health conditions. This paper focuses on the development of an ML model with high predictive accuracy to classify arrhythmic electrocardiogram (ECG) signals. The ECG signals datasets utilized in this study were sourced from the PhysioNet and MIT-BIH databases. The research commenced with binary classification, where an optimized Bidirectional Long Short-Term Memory (Bi-LSTM) model yielded excellent results in differentiating normal and atrial fibrillation signals. A pivotal aspect of this research was a survey among medical professionals, which not only validated the practicality of AI-based ECG classifiers but also identified areas for improvement, including accuracy and the inclusion of more arrhythmia types. These insights drove the development of an advanced Convolutional Neural Network (CNN) system capable of classifying five different types of ECG signals with better accuracy and precision. The CNN model's robust performance was ensured through rigorous stratified 5-fold cross validation. A web portal was also developed to demonstrate real-world utility, offering access to the trained model for real-time classification. This study highlights the potential applications of such models in remote health monitoring, predictive healthcare, assistive diagnostic tools, and simulated environments for educational training and interdisciplinary collaboration between data scientists and medical personnel.

Figures

Figures reproduced from arXiv: 2412.05583 by the authors.

Figure 2
Figure 2. Block diagram of methodology International Conference on Technologies for Computer, Electrical, Electronics & Communication (ICT-CEEL 2023) 158 [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Sporadic Federated Learning Approach in Quantum Environment to Tackle Quantum Noise

    quant-ph 2025-07 reject novelty 4.0 of 10

    SpoQFL applies sporadic learning to quantum federated learning by suppressing noisy client updates, claiming higher accuracy and more stable convergence in noisy-device simulations.

Reference graph

Works this paper leans on

23 extracted references · 14 canonical work pages · cited by 1 Pith paper

  1. [1]

    Arrhythmia Detection - A Machine Learning based Comparative Analysis with MIT -BIH ECG Data,

    V. Sardana, and H. K. Sardana, “Arrhythmia Detection - A Machine Learning based Comparative Analysis with MIT -BIH ECG Data,” 2019 IEEE 5th International Conference for Convergence in Technology, I2CT 2019 , Mar. 2019, doi: 10.1109/I2CT45611.2019.9033665

    arXiv 2019

  2. [2]

    Computational Diagnostic Techniques for Electrocardiogram Signal Analysis,

    L. Xie, Z. Li, Y. Zhou, Y. He, and J. Zhu, “Computational Diagnostic Techniques for Electrocardiogram Signal Analysis,” Sensors 2020, Vol. 20, Page 6318 , vol. 20, no. 21, p. 6318, Nov. 2020, doi: 10.3390/S20216318

    work page doi:10.3390/s20216318 2020

  3. [3]

    Global, Regional, and National Burden of Cardiovascular Diseases for 10 Causes, 1990 to 2015,

    G. A. Roth et al. , “Global, Regional, and National Burden of Cardiovascular Diseases for 10 Causes, 1990 to 2015,” J Am Coll Cardiol, vol. 70, no. 1, pp. 1 –25, Jul. 2017, doi: 10.1016/J.JACC.2017.04.052

    work page doi:10.1016/j.jacc.2017.04.052 1990

  4. [4]

    Automated Identication of Atrial Fibrillation from Single-lead ECGs Using Multi-branching ResNet

    J. Xie, S. Stavrakis, and B. Yao, “Automated Identication of Atrial Fibrillation from Single -lead ECGs Using Multi -branching ResNet,” Jun. 2023, Accessed: Jul. 29, 2023. [Online]. Available: http://arxiv.org/abs/2306.15096

    work page Pith review arXiv 2023

  5. [5]

    Physiology of cardiac pumping,

    K. Anttila and A. P. Farrell, “Physiology of cardiac pumping,” Reference Module in Life Sciences , 2022, doi: 10.1016/B978 -0-323- 90801-6.00005-7

    doi:10.1016/b978 2022

  6. [6]

    Atrial Fibrillation,

    Z. Nesheiwat, A. Goyal, and M. Jagtap, “Atrial Fibrillation,” StatPearls, pp. 1 –8, Apr. 2023, Accessed: Sep. 11, 2023. [Online]. Available: https://www.ncbi.nlm.nih.gov/books/NBK526072/

    work page 2023

  7. [7]

    Detection of Heart Arrhythmia on Electrocardiogram using Artificial Neural Networks,

    M. Badr, S. Al -Otaibi, N. Alturki, and T. Abir, “Detection of Heart Arrhythmia on Electrocardiogram using Artificial Neural Networks,” Comput Intell Neurosci, vol. 2022, 2022, doi: 10.1155/2022/1094830

    work page doi:10.1155/2022/1094830 2022

  8. [8]

    Time and Frequency Exploration of ECG Signal,

    G. SharanYadav, S. Yadav, and P. Prachi, “Time and Frequency Exploration of ECG Signal,” Int J Comput Appl, vol. 67, no. 4, 2013, doi: 10.5120/11381-6659

    work page doi:10.5120/11381-6659 2013

Show all 23 references
  1. [9]

    ECG signal feature extraction trends in methods and applications,

    A. K. Singh and S. Krishnan, “ECG signal feature extraction trends in methods and applications,” Biomed Eng Online , vol. 22, no. 1, Dec. 2023, doi: 10.1186/S12938-023-01075-1

    2023 doi

  2. [10]

    Advanced Time-Frequency Methods for ECG Waves Recognition,

    A. Zyout, H. Alquran, W. A. Mustafa, and A. M. Alqudah, “Advanced Time-Frequency Methods for ECG Waves Recognition,” Diagnostics, vol. 13, no. 2, 2023, doi: 10.3390/diagnostics13020308

    2023 doi

  3. [11]

    A review on deep learning methods for ECG arrhythmia classification,

    Z. Ebrahimi, M. Loni, M. Daneshtalab, and A. Gharehbaghi, “A review on deep learning methods for ECG arrhythmia classification,” Expert Systems with Applications: X , vol. 7, p. 100033, Sep. 2020, doi: 10.1016/J.ESWAX.2020.100033

    2020

  4. [12]

    Saadatnejad, M

    S. Saadatnejad, M. Oveisi, and M. Hashemi, “IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS 1 LSTM -Based ECG Classification for Continuous Monitoring on Personal Wearable Devices ‘LSTM-Based ECG Classification for Continuous Monitoring on Personal Wearab le Devices,’” IEEE ...

    2019

  5. [13]

    IoT Based System for Heart Monitoring and Arrhythmia Detection Using Machine Learning,

    R. E. Cañón -Clavijo, C. E. Montenegro -Marin, P. A. Gaona -Garcia, and J. Ortiz -Guzmán, “IoT Based System for Heart Monitoring and Arrhythmia Detection Using Machine Learning,” J Healthc Eng, vol. 2023, 2023, doi: 10.1155/2023/6401673

    2023 doi

  6. [14]

    Analysis of ECG -based arrhythmia detection system using machine learning,

    S. Dhyani, A. Kumar, and S. Choudhury, “Analysis of ECG -based arrhythmia detection system using machine learning,” MethodsX, vol. 10, Jan. 2023, doi: 10.1016/j.mex.2023.102195

    2023

  7. [15]

    A lightweight hybrid CNN -LSTM model for ECG - based arrhythmia detection,

    N. Alamatsaz, L. s Tabatabaei, M. Yazdchi, H. Payan, N. Alamatsaz, and F. Nasimi, “A lightweight hybrid CNN -LSTM model for ECG - based arrhythmia detection,” Aug. 2022, Accessed: Sep. 12, 2023. [Online]. Available: https://arxiv.org/abs/2209.00988v1

    2022 arXiv

  8. [16]

    AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017,

    G. D. Clifford et al., “AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017,” in Computing in Cardiology, IEEE Computer Society, 2017, pp. 1–4. doi: 10.22489/CinC.2017.065-469

    2017 doi

  9. [17]

    PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals.,

    A. L. Goldberger et al., “PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals.,” Circulation, vol. 101, no. 23, 2000, doi: 10.1161/01.cir.101.23.e215

    doi

  10. [18]

    The impact of the MIT-BIH arrhythmia database,

    G. B. Moody and R. G. Mark, “The impact of the MIT-BIH arrhythmia database,” IEEE Engineering in Medicine and Biology Magazine, vol. 20, no. 3, pp. 45–50, 2001, doi: 10.1109/51.932724

    2001 doi

  11. [19]

    Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow (2019, O’reilly),

    A. Géron, “Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow (2019, O’reilly),” Hands-On Machine Learning with R, p. 510, 2017, Accessed: Sep. 12, 2023. [Online]. Available: https://www.oreilly.com/library/view/hands-on-machine- learning/9781492032632/

    2019

  12. [20]

    A Comparative Study of the Use of Stratified Cross-Validation and Distribution-Balanced Stratified Cross- Validation in Imbalanced Learning,

    S. Szeghalmy and A. Fazekas, “A Comparative Study of the Use of Stratified Cross-Validation and Distribution-Balanced Stratified Cross- Validation in Imbalanced Learning,” Sensors, vol. 23, no. 4, Feb. 2023, doi: 10.3390/s23042333

    2023 doi

  13. [21]

    Probabilistic Extension of Precision, Recall, and F1 Score for More Thorough Evaluation of Classification Models,

    R. Yacouby Amazon Alexa and D. Axman Amazon Alexa, “Probabilistic Extension of Precision, Recall, and F1 Score for More Thorough Evaluation of Classification Models,” in Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems, 2020, pp. 79–91. doi: 10.186...

    2020 doi

  14. [22]

    QRS Wave Detection In Matlab Using Wavelet Transform,

    B. D. Vagadiya, Shivakrishnadasi, Dr. V. Bhatt, and K. Doshi, “QRS Wave Detection In Matlab Using Wavelet Transform,” International Journal of Engineering Research & Technology , vol. 2, no. 4, Apr. 2013, doi: 10.17577/IJERTV2IS4582

    2013 doi

  15. [23]

    A Resampling Method for Imbalanced Datasets Considering Noise and Overlap,

    T. Sasada, Z. Liu, T. Baba, K. Hatano, and Y. Kimura, “A Resampling Method for Imbalanced Datasets Considering Noise and Overlap,” Procedia Comput Sci , vol. 176, pp. 420 –429, Jan. 2020, doi: 10.1016/J.PROCS.2020.08.04 International Conference on Technologies for Computer, El...

    2020 doi

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.