REVIEW 4 major objections 5 minor 71 references
Qiskit Variational Quantum Classifier on the Pulsar Classification Problem
T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A Qiskit variational quantum classifier reaches 95 percent accuracy on pulsar candidates from the HTRU-2 survey.
desk verdict Routine QML application to HTRU-2 whose headline accuracy is arithmetically impossible given the stated class imbalance; the reported numbers don't add up. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is the Variational Quantum Classifier (VQC), a hybrid quantum-classical algorithm built from two parameterized circuits: a feature map that encodes classical data into qubit rotations (the Pauli or ZZ feature map, both angle-embedding circuits) and an ansatz whose parameters are trained classically (Real Amplitudes or EfficientSU2). The number of qubits equals the number of features, and the circuits are repeated twice with linear, circular, or full CNOT entanglement. The VQC carries the argument because every reported comparison—feature count, feature-selection method, training size, encoding, ansatz, and entanglement—is a variation on this circuit recipe.
What would settle it
Rerun the three-feature VQC configuration with feature selection fitted inside each training fold of a cross-validation loop on the full HTRU-2 dataset, and compare the held-out accuracy with the reported 0.950. If the cross-validated accuracy falls materially below 0.950, the headline number came from leakage or from selecting the best of many configurations on the test set.
Extended reading notes
Core claim
The paper's central claim is that the Variational Quantum Classifier, as implemented in Qiskit's machine learning library, is a usable and reasonably accurate tool for pulsar candidate classification on the HTRU-2 dataset. Concretely, a configuration with three features selected by a statistical score or by absolute correlation with the class, a ZZ or Pauli feature map, and an EfficientSU2 ansatz achieves accuracy up to 0.950 and MCC up to 0.670. The paper attributes the result to the interaction of circuit components rather than to any single ingredient: the best-performing models all use an EfficientSU2 ansatz, while using the data-encoding circuit itself as the ansatz gives high precision but much lower accuracy. The experiments are presented as evidence that hybrid quantum-classical classifiers can be applied to real astronomical surveys now, with tests on real quantum hardware and noisy simulators left to future work.
Load-bearing premise
The reported 0.950 accuracy is only a trustworthy estimate of future performance if feature selection was fitted on the training portion alone and if the best configurations were not chosen by looking at the test set; the paper does not state exactly when the feature-selection step was applied.
Editorial extensions
If this is right
- A three-qubit VQC is enough to reach the paper's best results, so the practical resource cost of the classifier stays low on near-term hardware.
- Circuit identity matters: every top configuration uses the EfficientSU2 ansatz, while reusing the feature map as the ansatz changes the precision-recall tradeoff and lowers accuracy.
- Feature-selection method shifts the error balance: FS1 gives better recall and MCC, while FS2 gives slightly better precision at similar accuracy.
- Training on 180 samples produced higher accuracy than training on 300 samples in this setup, which the paper reads as a sign that the model's performance depends on batch composition.
- The results support treating hybrid quantum-classical classification as a candidate screening tool for pulsar surveys, with real-device and noisy-simulation tests as the next step.
Reading between the lines
- The paper does not compare the VQC with classical baselines on the same split, so the practical inference to draw is feasibility rather than superiority; a direct classical benchmark would put the 0.950 number in context.
- If the feature-selection order is ambiguous, the result can be stress-tested by repeating the three-feature configuration with feature selection nested inside every training fold.
- The strong dependence on entanglement pattern suggests that entanglement topology is a free hyperparameter of quantum classifiers, analogous to the kernel choice in classical support-vector machines, and worth tuning systematically.
- Because the best numbers come from a search over many configurations, rerunning the same experiment with a pre-registered configuration list would show how much of the 0.950 is attributable to the search itself.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript applies Qiskit's Variational Quantum Classifier (VQC) to the HTRU-2 pulsar candidate dataset. It normalizes data with MinMaxScaler, compares two feature-selection orderings (FS1 via SelectKBest, FS2 via correlation with the class), varies the number of features/qubits between 2 and 8, training sample sizes of 180 and 300, feature maps (ZZ and Pauli), ansatze (Real Amplitudes and EfficientSU2), and entanglement patterns. Performance is reported via accuracy, precision, recall, F1, and MCC. The central conclusion is that the VQC is easy to use and performs well, with accuracies as high as 0.950 and a best MCC of 0.670.
Significance. The empirical question addressed is of some interest for QML applications in astrophysics, and the manuscript is honest about the class imbalance by reporting MCC alongside accuracy. Its strength is a fairly systematic sweep of circuit components and feature-selection choices for a specific Qiskit implementation. However, the contribution is incremental relative to existing QML pulsar classification studies, and the central empirical claim is currently unsupported: the headline numbers in Table VII are internally inconsistent, the model selection procedure uses test performance, no classical baseline is given, and no code, seeds, or repeated runs are provided. If the experiments were rerun with proper validation and baselines, the paper could be a useful application note, but as it stands the reported 'good performance' is not a reliable measurement.
major comments (4)
- [Section IV, Table VII] The headline accuracy entries are arithmetically inconsistent with the precision, recall, and the dataset's stated 9.8% pulsar rate. For a test set with pulsar fraction p, the metrics imply Acc = 1 - p[R(1-P)/P + (1-R)]. With p=0.098, row 1 (Acc 0.950, P 0.375, R 0.750) gives 0.853; row 2 (Acc 0.945, P 0.476, R 1.000) gives 0.892; and row 3 (Acc 0.940, P 0.429, R 1.000) gives 0.870. The paper does not report any rebalancing or filtering of the test set, and Section II A describes the data as having 9.8% pulsars. Either the accuracy or the other metrics are not from the same evaluation, and the Conclusion's 'accuracies as high as 0.950' is therefore unsupported by the reported numbers.
- [Section IV, Figs. 7-10 and Table VII] The reported values are selected maxima over a large grid of configurations, with no validation set and no repeated runs. The text states that some of the 'best-performing (BP) models, based on accuracy' were selected and that Table VII entries whose counterpart 'was not high enough' were 'filtered out'. Selecting on the test set makes the headline accuracy an estimate of the search procedure, not of generalization. The authors should report held-out or nested-validation performance with means and standard deviations over repeated runs, or the claim of 'good performance' cannot be evaluated.
- [Section II C] It is not stated whether the FS1 and FS2 feature-selection procedures were applied before or after the train/test split. If the feature ranking was computed on the full dataset, class labels of the test set influenced the preprocessing, and all downstream numbers are optimistically biased. This must be clarified and, if leakage exists, the experiments must be rerun with feature selection nested inside the training folds.
- [Section IV and Conclusion] No classical baseline is reported for the same data and preprocessing, and no comparison is made to the HTRU-2 results in the cited literature or to the QML pulsar studies cited as Refs. [29,30]. Without a baseline, 'good performance' is not a supported claim: on a dataset with 9.8% positives, a degenerate classifier can already reach roughly 0.902 accuracy, so accuracy alone is insufficient evidence. A comparison against standard classical classifiers (e.g., logistic regression, random forest, SVM) on the same train/test protocol is needed.
minor comments (5)
- [Section II A] 'HRTU-2' should be 'HTRU-2'.
- [Fig. 8 and Fig. 10 captions] 'representend' should be 'represented', and 'est performing' should be 'best performing'.
- [Table III] BP-A and BP-B list identical configurations (ZZ feature map, Real Amplitudes, linear entanglement); if this is not a typo, the labels cannot distinguish the two curves in Fig. 7.
- [General] No Qiskit version, random seeds, or code availability are reported, which limits reproducibility of the single-run results.
- [Table VII] The notation 'EfficientSU2' is written without a space in some rows; consistent naming would improve readability.
Circularity Check
No circularity: the paper reports empirical VQC benchmark results on HTRU-2 and does not derive or predict any quantity from its own fitted inputs; internal metric inconsistencies are a soundness issue, not circular reasoning.
full rationale
The paper's central claim, 'The VQC circuit... achieving accuracies as high as 0.950,' is an observed benchmark result taken from Table VII, not a derived prediction. There is no derivation chain in which an output is defined in terms of an input: accuracy, precision, recall, F1, and MCC are all computed from TP/FP/FN/TN using the standard formulas in Appendix A, and no parameter is fitted and then renamed as a prediction. The feature-selection methods FS1 and FS2 are standard rankers whose outputs are not defined in terms of the final accuracy or MCC, and the feature-map/ansatz choices are varied as independent configuration options. The paper contains no load-bearing self-citations and no uniqueness theorem imported from prior work by the authors. The text does contain a serious empirical inconsistency in Table VII: for a test set with the stated 9.8% pulsar fraction, row 1 (Acc 0.950, Precision 0.375, Recall 0.750) would imply Acc approximately 0.853, and other rows are similarly inconsistent; this is a correctness or reporting defect in the evaluation setup, not circularity. Likewise, the statement that some configurations 'got filtered out, as a way to not introduce bias' indicates that the headline number is a selected maximum over a searched grid, which undermines generalization claims but is not definitional circularity. Because the paper makes no first-principles derivation and never equates an output with its own input by construction, the circularity score is 0.
Assumptions & free parameters
free parameters (5)
- Number of features =
3 (and 4 in some runs)
- Feature map type =
ZZFeatureMap
- Ansatz type =
EfficientSU2
- Entanglement pattern =
circular or full
- Training data size =
180 and 300
assumptions (4)
- domain assumption HTRU-2 dataset labels are correct and the eight features are as described in [31].
- domain assumption Qiskit's VQC implementation faithfully realizes the described feature maps, ansatz, and optimizer (SLSQP) with default settings.
- domain assumption MinMax scaling to [0, pi] preserves the information needed for the classification task.
- domain assumption The train/test split is random and representative of the dataset distribution.
Cite this review
Pith. "Pith review of Qiskit Variational Quantum Classifier on the Pulsar Classification Problem." pith.science (2026). https://pith.science/paper/PUGHY4AJ
@misc{pith2026250515600,
author = {Pith},
title = {Pith review of: Qiskit Variational Quantum Classifier on the Pulsar Classification Problem},
year = {2026},
howpublished = {\url{https://pith.science/paper/PUGHY4AJ}},
note = {Machine review of arXiv:2505.15600}
}
read the original abstract
Quantum Machine Learning is a new computational tool that combines the quantum properties from quantum computing with the pattern recognition from machine learning. In this paper, we apply the Variational Quantum Classifier algorithm to the problem of pulsar classification of candidates from the High Time Resolution Universe 2 dataset. We use Qiskit Machine Learning circuits to compare the performance of the model using different feature selection methods, various number of features and training data size. Comparisons on the model from changing the data encoding and ansatz options are also reported. Keywords: Quantum Computing, Quantum Machine Learning, Astrophysics, Pulsars
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
R. A. Hulse and J. H. Taylor, The Astrophysical Journal 195 (1975), 10.1086/181708
doi:10.1086/181708 1975
-
[4]
S. Johnston, A. Karastergiou, M. Keith, X. Song, P. Wel- tevrede, F. Abbate, M. Bailes, S. Buchner, F. Camilo, M. Geyer, et al. , Monthly Notices of the Royal Astro- nomical Society 493, 3608 (2020)
work page 2020
- [5]
-
[6]
K. Stovall, R. Lynch, S. Ransom, A. Archibald, S. Ba- naszak, C. Biwer, J. Boyles, L. Dartez, D. Day, A. Ford, et al. , The Astrophysical Journal 791, 67 (2014)
work page 2014
-
[7]
J. S. Deneva, J. M. Cordes, M. A. McLaughlin, D. J. Nice, D. Lorimer, F. Crawford, N. Bhat, F. Camilo, D. Cham- pion, P. Freire, et al. , The Astrophysical Journal 703, 2259 (2009)
work page 2009
-
[8]
R. N. Manchester, A. G. Lyne, F. Camilo, J. F. Bell, V. Kaspi, N. D’Amico, N. McKay, F. Crawford, I. Stairs, A. Possenti, et al. , Monthly Notices of the Royal Astro- nomical Society 328, 17 (2001)
work page 2001
-
[9]
I. H. Stairs, Living Reviews in Relativity 6, 1 (2003)
work page 2003
Show all 71 references
-
[10]
Kramer, I
M. Kramer, I. H. Stairs, R. Manchester, M. McLaughlin, A. Lyne, R. Ferdman, M. Burgay, D. Lorimer, A. Pos- senti, N. D’Amico, et al. , science 314, 97 (2006)
2006
-
[11]
F. A. Jenet, A. Lommen, S. L. Larson, and L. Wen, The Astrophysical Journal 606, 799 (2004)
2004
-
[12]
Becker, M
W. Becker, M. Kramer, and A. Sesana, Space Science Reviews 214, 1 (2018)
2018
-
[13]
W. J. Clancey, Classification problem solving (Stanford University Stanford, CA, 1984)
1984
-
[14]
Johnston, A
S. Johnston, A. Lyne, R. Manchester, D. Kniffen, N. D’amico, J. Lim, and M. Ashworth, Monthly Notices of the Royal Astronomical Society 255, 401 (1992)
1992
-
[15]
Braun, T
R. Braun, T. L. Bourke, J. A. Green, E. Keane, and J. Wagg, inAdvancing Astrophysics with the Square Kilo- metre Array, Vol. 215 (Sissa Medialab, 2015) p. 174
2015
-
[16]
J. R. Song, in Journal of Physics: Conference Series , Vol. 2428 (IOP Publishing, 2023) p. 012046
2023
-
[17]
Kannan and A
S. Kannan and A. D. Shanbhag, in 2024 4th Interna- tional Conference on Electrical, Computer, Communica- tions and Mechatronics Engineering (ICECCME) (IEEE,
2024
-
[18]
Beniwal, A
D. Beniwal, A. Roy, H. Yadav, and A. Chauhan, in 2021 2nd International Conference for Emerging Technology (INCET) (2021) pp. 1–7
2021
-
[19]
Y. Wang, Z. Pan, J. Zheng, L. Qian, and M. Li, Astro- physics and Space Science 364, 1 (2019)
2019
-
[20]
Z. Chen, A. Xu, Y. Zhou, and Y. Gai, in 2020 3rd Inter- national Conference on Intelligent Autonomous Systems (ICoIAS) (IEEE, 2020) pp. 14–18
2020
-
[21]
Thanu and V
S. Thanu and V. Subha, RICE , 93 (2023)
2023
-
[22]
McFarthing, A
S. McFarthing, A. Pillay, I. Sinayskiy, and F. Petruc- cione, Quantum Machine Intelligence 6, 81 (2024)
2024
-
[23]
Tariq, M
I. Tariq, M. Qiao, L. Wei, S. Yao, C. Zhou, Z. Ali, S. W. Azeem, and A. Spanakis-Misirlis, Journal of Instrumen- tation 17 (2022), 10.1088/1748-0221/17/03/P03020
2022 doi
-
[24]
Holewik, G
J. Holewik, G. Schaefer, and I. Korovin, in Advances in Swarm Intelligence: 11th International Conference, ICSI 2020, Belgrade, Serbia, July 14–20, 2020, Proceedings 11 (Springer, 2020) pp. 515–524
2020
-
[25]
McFadden, A
R. McFadden, A. Karastergiou, and S. Roberts, Pro- ceedings of the International Astronomical Union 13, 372 (2017)
2017
-
[26]
Schuld, I
M. Schuld, I. Sinayskiy, and F. Petruccione, Contempo- rary Physics 56 (2015), 10.1080/00107514.2014.964942
2015
-
[27]
Schuld and F
M. Schuld and F. Petruccione, Quantum science and technology (Springer, 2018) (2018)
2018
-
[28]
Majid, S
B. Majid, S. A. Sofi, and Z. Jabeen, Quantum Machine Intelligence 7, 1 (2025)
2025
-
[29]
Tariq, Q
I. Tariq, Q. Meng, S. Yao, W. Liu, C. Zhou, A. Ahmed, and A. Spanakis-Misirlis, Monthly Notices of the Royal Astronomical Society 511, 683 (2022)
2022
-
[30]
Slabbert, Matt, and F
D. Slabbert, Matt, and F. Petruccione, Pulsar classi- fication: comparing quantum convolutional neural net- works and quantum support vector machines. Quantum Machine Intelligence (2024)
2024
-
[31]
R. J. Lyon, B. W. Stappers, S. Cooper, J. M. Brooke, and J. D. Knowles, Monthly Notices of the Royal Astro- nomical Society 459, 1104 (2016)
2016
-
[32]
R. J. Lyon, Why are pulsars hard to find? (The Univer- sity of Manchester (United Kingdom), 2016)
2016
-
[33]
P. Guo, F. Duan, P. Wang, Y. Yao, Q. Yin, X. Xin, D. Li, L. Qian, S. Wang, Z. Pan, et al., Monthly Notices of the Royal Astronomical Society 490, 5424 (2019)
2019
-
[34]
Azhari, A
M. Azhari, A. Abarda, A. Alaoui, B. Ettaki, and J. Ze- rouaoui, Procedia Computer Science 170, 1096 (2020)
2020
-
[35]
Beniwal, A
D. Beniwal, A. Roy, H. Yadav, and A. Chauhan, in 2021 2nd International Conference for Emerging Technology (INCET) (IEEE, 2021) pp. 1–7
2021
-
[36]
Krzywinski and N
M. Krzywinski and N. Altman, Nature methods 11 (2014)
2014
-
[37]
P. J. M. Ali, R. H. Faraj, E. Koya, P. J. M. Ali, and 9 R. H. Faraj, Mach Learn Tech Rep 1, 1 (2014)
2014
-
[38]
Cabello-Solorzano, I
K. Cabello-Solorzano, I. Ortigosa de Araujo, M. Pe˜ na, L. Correia, and A. J. Tall´ on-Ballesteros, inInternational conference on soft computing models in industrial and environmental applications (Springer, 2023) pp. 344–353
2023
-
[39]
Nayak, B
S. Nayak, B. B. Misra, and H. S. Behera, International Journal of Computer Information Systems and Industrial Management Applications 6, 13 (2014)
2014
-
[40]
H. A. Ahmed, P. J. M. Ali, A. K. Faeq, and S. M. Ab- dullah, aro-the scientific journal of koya university10, 29 (2022)
2022
-
[41]
Tharwat, Applied Computing and Informatics 17 (2018), 10.1016/j.aci.2018.08.003
A. Tharwat, Applied Computing and Informatics 17 (2018), 10.1016/j.aci.2018.08.003
2018 doi
-
[42]
Chicco and G
D. Chicco and G. Jurman, BioData Mining 16, 4 (2023)
2023
-
[43]
Chicco and G
D. Chicco and G. Jurman, BMC genomics 21, 1 (2020)
2020
-
[44]
Bashir, G
D. Bashir, G. D. Monta˜ nez, S. Sehra, P. S. Segura, and J. Lauw, in AI 2020: Advances in Artificial Intelligence: 33rd Australasian Joint Conference, AI 2020, Canberra, ACT, Australia, November 29–30, 2020, Proceedings 33 (Springer, 2020) pp. 347–358
2020
-
[45]
O. A. Montesinos L´ opez, A. Montesinos L´ opez, and J. Crossa, in Multivariate statistical machine learning methods for genomic prediction (Springer, 2022) pp. 109– 139
2022
-
[46]
Kohavi and G
R. Kohavi and G. H. John, Artificial intelligence 97, 273 (1997)
1997
-
[47]
Guyon and A
I. Guyon and A. Elisseeff, Journal of machine learning research 3, 1157 (2003)
2003
-
[48]
M¨ ucke, R
S. M¨ ucke, R. Heese, S. M¨ uller, M. Wolter, and N. Pi- atkowski, Quantum Machine Intelligence 5, 11 (2023)
2023
-
[49]
Chandrashekar and F
G. Chandrashekar and F. Sahin, Computers & electrical engineering 40, 16 (2014)
2014
-
[50]
Z. Zhao, F. Morstatter, S. Sharma, S. Alelyani, A. Anand, and H. Liu, ASU feature selection repository , 1 (2010)
2010
-
[51]
Langley et al
P. Langley et al. , in Proceedings of the AAAI Fall sym- posium on relevance, Vol. 184 (California, 1994) pp. 245– 271
1994
-
[52]
Preskill, Quantum 2, 79 (2018)
J. Preskill, Quantum 2, 79 (2018)
2018
-
[53]
J. W. Z. Lau, K. H. Lim, H. Shrotriya, and L. C. Kwek, AAPPS bulletin 32, 27 (2022)
2022
-
[54]
M. A. Hall, Correlation-based feature selection for ma- chine learning , Ph.D. thesis, The University of Waikato (1999)
1999
-
[55]
A. Kaur, K. Guleria, and N. K. Trivedi, in 2021 Inter- national Conference on Advance Computing and Inno- vative Technologies in Engineering (ICACITE) (IEEE,
2021
-
[56]
J. Cai, J. Luo, S. Wang, and S. Yang, Neurocomputing 300, 70 (2018)
2018
-
[57]
Cohen, Y
I. Cohen, Y. Huang, J. Chen, J. Benesty, J. Benesty, J. Chen, Y. Huang, and I. Cohen, Noise reduction in speech processing , 1 (2009)
2009
-
[58]
J. R. McClean, J. Romero, R. Babbush, and A. Aspuru- Guzik, New Journal of Physics 18, 023023 (2016)
2016
-
[59]
Cerezo, A
M. Cerezo, A. Arrasmith, R. Babbush, S. C. Benjamin, S. Endo, K. Fujii, J. R. McClean, K. Mitarai, X. Yuan, L. Cincio, et al. , Nature Reviews Physics 3, 625 (2021)
2021
-
[60]
Adebayo, F
P. Adebayo, F. Basaky, and E. Osaghae, UMYU Scien- tifica 2, 65 (2023)
2023
-
[61]
D. A. Fedorov, B. Peng, N. Govind, and Y. Alexeev, Materials Theory 6, 2 (2022)
2022
-
[62]
Saxena and A
N. Saxena and A. Nigam, in 2022 IEEE 9th Uttar Pradesh Section International Conference on Electri- cal, Electronics and Computer Engineering (UPCON) (IEEE, 2022) pp. 1–5
2022
-
[63]
Maheshwari, D
D. Maheshwari, D. Sierra-Sosa, and B. Garcia-Zapirain, IEEE access 10, 3705 (2021)
2021
-
[64]
Hangun, O
B. Hangun, O. Eyecioglu, and O. Altun, in 2024 12th International Conference on Smart Grid (icSmartGrid) (IEEE, 2024) pp. 840–843
2024
-
[65]
Munasinghe, P
T. Munasinghe, P. Lai, J. Wei, J. Hendler, and K. A. Cornell, in 2024 IEEE International Conference on Big Data (BigData) (IEEE, 2024) pp. 4357–4366
2024
-
[66]
Mukhamedieva and R
D. Mukhamedieva and R. Sobirov, in E3S web of confer- ences, Vol. 494 (EDP Sciences, 2024) p. 04024
2024
-
[67]
W. R. Khan, M. A. Kamran, M. U. Khan, M. M. Ibrahim, K. S. Kim, and M. U. Ali, International Journal of In- telligent Systems 2025, 1351522 (2025)
2025
-
[68]
Belis, S
V. Belis, S. Gonz´ alez-Castillo, C. Reissel, S. Vallecorsa, E. F. Combarro, G. Dissertori, and F. Reiter, in EPJ Web of Conferences , Vol. 251 (EDP Sciences, 2021) p. 03070
2021
-
[69]
Regad ´ ıo, Quantum Machine Intelligence7, 1 (2025)
A. Regad ´ ıo, Quantum Machine Intelligence7, 1 (2025)
2025
-
[70]
Bhavsar, N
R. Bhavsar, N. K. Jadav, U. Bodkhe, R. Gupta, S. Tan- war, G. Sharma, P. N. Bokoro, and R. Sharma, IEEE Access 11, 75829 (2023)
2023
-
[71]
Ibm quantum documentation,
“Ibm quantum documentation,”
-
[72]
Suzuki, H
Y. Suzuki, H. Yano, Q. Gao, S. Uno, T. Tanaka, M. Akiyama, and N. Yamamoto, Quantum Machine In- telligence 2, 1 (2020)
2020
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.