Pith. sign in

REVIEW 2 major objections 4 minor 1 cited by

Quantum Index Report 2025

T0 review · 2 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Quantum processing units improve impressively but remain far from running large-scale commercial applications, and no modality or manufacturer has emerged as a clear leader.

desk verdict Useful industry data report with real original data, but the headline benchmark conclusion rests on vendor-reported specs the authors themselves admit are incomparable. read the letter →

arxiv 2506.04259 v1 pith:42JQECYB submitted 2025-06-02 physics.soc-ph quant-ph

Jonathan Ruane , Elif Kiesow , Johannes Galatsanos , Carl Dukatz , Edward Blomquist , Prashant Shukla This is my paper
classification physics.soc-phquant-ph
keywords quantumcomputingprocessingunitshardwarebenchmarkingpatentsventurefundingworkforcepublicopinionnetworking
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This report assembles public data on quantum patents, research output, venture funding, corporate communications, policy, workforce, education, public opinion, quantum networking testbeds, and quantum processor hardware to give nonexperts a data-driven picture of where quantum technology stands. Its central assessment is that quantum processing units (QPUs) are making impressive progress in performance but remain far from meeting the requirements for large-scale commercial applications such as chemical simulation or cryptanalysis. Across every current and planned platform—superconducting, trapped-ion, neutral atom, photonic, electron spin, and others—no single modality or manufacturer has emerged as a clear leader. The report also finds that the sector is growing across nearly every indicator it tracks, from venture funding and corporate discussion to academic output and government strategy, even though quantum still draws less than 1% of worldwide venture capital. A sympathetic reader would take away that quantum is advancing broadly and rapidly, but the useful, universally capable quantum computer is not here yet.

What carries the argument

The load-bearing object is the report's QPU dataset: roughly 200 indexed processors with publicly disclosed or vendor-provided specifications, organized by modality, country, commercial availability, and announced roadmaps. The analytic work is done by pairwise benchmark plots—qubit count against two-qubit gate error rate, gate speed against gate error rate, and quantum volume over time—with the caveat that error rates are measured differently across devices, such as mid-circuit versus first-gate, average versus median, and different gate types. These plots, together with the modality-by-modality descriptions of superconducting, trapped-ion, photonic, neutral-atom, electron-spin, nitrogen-vacancy, Majorana, and annealer designs, carry the conclusion that each platform trades off speed, fidelity, scale, and manufacturability differently. The conceptual mechanism is the distinction between raw physical benchmarks and end-to-end performance: like horsepower versus lap time, physical specs only partially predict whether a QPU can run a real algorithm, and application-level benchmarks are rarely published because today's QPUs cannot run sizable applications.

What would settle it

One concrete check would be to run a standardized, third-party benchmark suite using the same circuits, error-correction setup, and measurement protocol across all commercially available QPUs; if a single manufacturer or modality consistently won on qubit count, two-qubit fidelity, gate speed, and quantum volume simultaneously, the no-clear-leader claim would collapse. The far-from-commercial-applications claim would be falsified by a demonstrated QPU execution of an error-corrected circuit long enough for a useful task, such as a quantum chemistry simulation requiring on the order of $10^{13}$ logical gates, completed in practical time.

Watch

Extended reading notes

Core claim

The report's central finding is that the quantum computing field is advancing on a broad front without a winner: over 200 QPUs were indexed across 17 countries, with more than 40 commercially available from at least two dozen manufacturers as of April 2025, and the United States leads in number and diversity of commercial QPUs, followed by China. On the physical benchmarks that dominate current data, superconducting systems hold the largest commercial share and the fastest gate speeds, while trapped-ion systems achieve the highest two-qubit gate fidelities and connectivity but suffer from slow gates and small qubit counts; neutral atoms promise scalability with moderate fidelity, and photonics remains early. The report treats qubit count as an unreliable standalone measure, noting that IBM shipped the higher-performing 133-qubit Heron after larger Condor and Osprey chips and that Quantinuum still leads on its 20-qubit H1, and it emphasizes that gate speed sets a hard limit: a quantum phase-estimation circuit exceeding $10^{13}$ logical gates on a trapped-ion processor would take days for one run and years for a statistically meaningful ensemble. Its decision-relevant conclusion is that no modality or manufacturer has yet established overall leadership, and QPUs remain far from running large-scale commercial applications such as chemical simulation or cryptanalysis.

Load-bearing premise

The comparison rests on the assumption that vendor-disclosed specifications are accurate and comparable across devices, even though the report itself notes error rates are measured differently, for example mid-circuit versus first-gate, average versus median, and different gate types, and that only 3 of 31 trapped-ion QPUs disclose gate speed.

Editorial extensions

If this is right

  • If the report is right, buyers and investors should treat qubit count as a poor standalone metric and instead compare error-corrected circuit depth and gate speed when evaluating QPUs.
  • No-modality leadership means diversified portfolios across superconducting, trapped-ion, neutral-atom, and photonic platforms are a reasonable hedged strategy until a clear winner emerges.
  • Large-scale commercial workloads like chemistry simulation and cryptanalysis should be planned as multi-year targets rather than near-term deployments, with classical emulation at roughly 50 logical qubits remaining the practical ceiling.
  • The absence of application-level benchmarks today will become a bottleneck as hardware improves, pushing manufacturers toward standardized, independently verifiable benchmarks.
  • Because QPUs are far from commercial requirements, the near-term value of quantum is likely to remain in research, education, and strategic experimentation rather than production computing.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the benchmarking trend continues—fidelity rising faster than qubit count—the field's natural scorecard may shift from number of qubits to logical qubits at a stated circuit depth, which would change how roadmaps and investment news are read.
  • The report's US-centered survey, job-posting, and education data likely understate activity in Europe and Asia, so a global version of the index could surface different leaders in workforce and public acceptance.
  • The surge in corporate mentions of quantum computing could partly reflect hype or strategic signaling rather than actual deployments, so communications data should be weighed against hardware benchmarks rather than read as evidence of readiness.
  • If a vendor ever publishes third-party-verified simultaneous leadership across scale, fidelity, and speed, the no-clear-leader conclusion would have a natural expiry date; patent and venture data suggest candidates are still accumulating capabilities.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. This manuscript is the inaugural MIT Quantum Index Report, a data-driven aggregation of indicators across quantum computing and networking: patents, academic publications, venture funding, corporate communications, policy, workforce, education, public opinion, quantum networking testbeds, and QPU benchmarking. It compiles public and vendor-reported data into descriptive statistics and visualizations, and its central assessment is that quantum processing units are improving rapidly but remain far from large-scale commercial applications, with no single modality or manufacturer having emerged as a clear leader. The report is accompanied by an interactive website and open raw data.

Significance. If the report's aggregate claims hold, it provides a useful snapshot of a fast-moving field and fills a gap in accessible, openly documented quantum-technology indicators. Its strengths include publishing raw data, disclosing data-collection methods in the appendix, and flagging many limitations (e.g., US focus, vendor-reported benchmarks, sparse funding disclosures). The central 'far from commercial applications' conclusion rests on algorithm-scale estimates that do not depend on vendor comparability. However, the report's 'no clear leader' and 'impressive progress' benchmarking claims rest on non-comparable vendor disclosures that the report itself acknowledges, and the workforce chapter contains an unresolved internal contradiction.

major comments (2)
  1. [Key Insights and §6.1–6.2] The report's headline workforce claim is internally inconsistent. Key Insights states 'quantum skills demand almost tripling since 2018,' and §6.1 says the share of 'quantum' skills in US job postings 'has grown almost three times' with 'sustained growth in quantum skills demand.' Yet §6.2, analyzing the same Lightcast data, states 'There is no evidence of sustained growth in quantum demand versus the overall labor market (which was very robust in 2021–2024).' These two statements cannot both describe the same series, and the report does not reconcile them; because the workforce narrative is one of the report's ten Key Insights, this contradiction needs to be resolved and the headline claim qualified to match the actual trend.
  2. [§10.3.2–10.5 and Executive Summary] The 'no clear leader' conclusion is drawn from cross-modal comparisons of vendor-disclosed QPU specifications that the report itself acknowledges are not commensurable. The data considerations in §10.3.2 and §10.4 state that 2Q error rates mix mid-circuit versus first-gate measurements, average versus median statistics, and different gate types, and §10.5 notes that only 3 of 31 trapped-ion QPUs disclose gate speed. Because the Executive Summary and §10.5 conclusions ('no single modality or manufacturer has yet emerged as a clear leader,' 'impressive progress') rely on these scatterplots, the report should either restrict such conclusions to subsets of QPUs with comparable measurement protocols, or explicitly frame them as vendor-reported and not directly comparable. As written, the central benchmarking claim is supported only by data whose comparability the report itself calls into question.
minor comments (4)
  1. [§8.1.1] The phrase 'bimodal distribution' is misleading; the largest single segment is 'somewhat familiar' (26%), with 25% 'not at all familiar' and 34% combined 'very/extremely familiar,' so the distribution is not clearly bimodal.
  2. [§9.2] The maps of quantum networking testbeds appear to contain rendered placeholder text (e.g., repeated '/gid00010' strings) rather than legible labels; the figures need to be replaced.
  3. [§10.7.1] The heading 'A look into the future: QPUs per country and modality' appears twice, with different content under each; the subsections should be renumbered and the titles disambiguated.
  4. [Appendix, Chapter 10] The methodology section says QPU data was reviewed by 'experts in their professional network' but does not state how many experts or what review criteria; adding this information would improve reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the report aggregates external datasets and draws descriptive summaries; no derivation or prediction reduces to its own inputs.

full rationale

This is an inaugural data-reporting document, not a derivational model. Each chapter aggregates independent external data sources (patent offices, ASPI/Web of Science, Lightcast, Studyportals, a new survey, and manufacturer-disclosed QPU specifications) and describes trends. The central claims—that QPUs are making impressive progress but remain far from large-scale commercial applications and that no single modality or manufacturer has yet emerged as a clear leader—are summaries of the same dataset, but the report does not fit a parameter to a subset and then predict a closely related quantity, and there is no equation that reduces a derived result to an input by construction. The data-comparability caveats in Chapter 10 are a validity threat to the comparative benchmark conclusions, but that is a correctness or measurement concern explicitly acknowledged by the authors, not circularity of the kind this analysis flags. Self-citations are limited to pointing readers to qir.mit.edu for interactive data and do not carry any load-bearing argument.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

The report is descriptive, so there are no fitted parameters or invented entities. Its conclusions rest on the representativeness of third-party datasets, keyword and classification choices, the comparability of vendor-reported QPU benchmarks, and the survey sampling assumptions.

assumptions (4)
  • domain assumption Third-party datasets used in the report are accurate and representative.
    Patents (TQI/LexisNexis), publications (ASPI/Web of Science), funding (TQI), workforce (Lightcast), education (StudyPortals/NSC), and communications (AlphaSense) are taken as ground truth for the report's rankings and trends.
  • domain assumption Quantum-relevant keywords and IPC codes capture the intended technology boundaries.
    The appendix lists keyword sets and IPC codes for patents, publications, and job postings; if these are too broad or too narrow, the country and sector league tables shift.
  • domain assumption Vendor-reported QPU benchmarks are comparable across modalities.
    Chapter 10 plots qubit counts, fidelities, gate speeds, and Quantum Volume using manufacturer disclosures, while the appendix acknowledges differences in measurement conventions.
  • domain assumption The survey sample represents US public opinion.
    Chapter 8 claims Census-aligned sampling for gender and age, but no weighting, margin of error, or sampling frame details are provided.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Quantum Index Report 2025." pith.science (2026). https://pith.science/paper/42JQECYB

@misc{pith2026250604259,
  author       = {Pith},
  title        = {Pith review of: Quantum Index Report 2025},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/42JQECYB}},
  note         = {Machine review of arXiv:2506.04259}
}
read the original abstract

The inaugural edition of the MIT Quantum Index Report (QIR). Quantum technologies are evolving from theoretical concepts into tangible technologies with commercial promise. Their rapid progress is capturing global attention and suggests we stand on the cusp of a second quantum revolution. Unlocking the quantum opportunity is not simple. One challenge is that quantum technologies can present a high barrier to understanding for nonexperts because they often rely on complex principles and concepts from a variety of specialist fields. This can lead to confusion and intimidation for business leaders, educators, policymakers and others. The Quantum Index Report aims to reduce the complexity and make it possible for a wider audience to have a deeper understanding of the quantum landscape. The Quantum Index Report provides a comprehensive, data-driven assessment of the state of quantum technologies. For this inaugural edition we have focused on quantum computing and networking. The report tracks, measures, and visualizes trends across research, development, education and public acceptance. It aggregates data from academia, industry and policy sources and aims to provide nonpartisan insights.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Exploring Quantum Responsible Innovation efforts in Canada and the world

    physics.soc-ph 2025-07 conditional novelty 4.0 of 10

    An analysis of national quantum strategies using a ten-principle Responsible Innovation framework finds Canada emphasizes the quantum race more than peers while underweighting inclusion, complementary innovation, and ...

Reference graph

Works this paper leans on

17 extracted references · 16 canonical work pages · cited by 1 Pith paper

  1. [1]

    not at all familiar

    rity and cryptography, responses showed 11% very nervous, 13% somewhat nervous, 30% neutral, 20% somewhat excited, and 26% very excited. The survey reveals the patterns in how the general public perceive different applications of quantum computing, with clear distinctions in emotional responses across various domains. Overall, across all applications, app...

    work page 2025

  2. [2]

    Other Countries

    Step 3: Researchers merged the applicants with identified types (from both initial filtering and LLM results) with the applicants who originally had type information provided by the vendor. Step 4: Merged data was manually controlled to ensure non-duplication and accuracy. The data presented in patent applications by country was provided by Accenture in c...

    work page 2025

  3. [4]

    4 C Delle Donne and others, ‘An Operating System for Executing Applications on Quantum Network Nodes’ (2025) 639 Nature

    work page 2025

  4. [5]

    <https:// quantuminternetalliance.org/2025/03/12/qia-researchers-create-first-operating-system-for-quantum-networks/> accessed 31 March

    work page 2025

  5. [6]

    Cat qubits

    6 'Quantum Networking: Findings and Recommendations for Growing American Leadership’ (n 6). 7 ibid. 8 ibid. 9 National Science and T echnology Council (n 3). 10 'Quantum Networking: Findings and Recommendations for Growing American Leadership’ (n 6). Footnotes Number of quantum networking testbeds 93 | MIT INITIATIVE ON THE DIGITAL ECONOMY 10 | Quantum Pr...

    work page 2025

  6. [7]

    perfect,

    has been met with skepticism from parts of the scientific community, as conclusive evidence for the topological nature of the Majorana zero modes remains under debate. L ogical Qubits Most quantum algorithms assume that a qubit is “perfect, ” i.e., that it behaves perfectly throughout the operations of the algorithm. In reality, qubits are error-prone and...

    work page 2025

  7. [8]

    Leading Trapped Ion devices are consistently growing their qubit count on an annual basis

    The more recent decline in absolute numbers reflects an increased focus on improved error correction and higher fidelity (see 10.3.2). Leading Trapped Ion devices are consistently growing their qubit count on an annual basis. The qubit count amongst leading quantum annealers grew steadily across the decade leading up to 2017 but has since stabilized. D at...

    work page

  8. [10]

    S., Bravyi, S., Cross, A., Gambetta, J

    3 Bishop, L. S., Bravyi, S., Cross, A., Gambetta, J. M., & Smolin, J. (2017). Quantum Volume. 4 Olivier Ezratty, ‘Understanding Quantum T echnologies 2024’ (Opinions Libres - Le blog d’Olivier Ezratty) <https://www.oezratty.net/ wordpress/2024/understanding-quantum-technologies-2024/> accessed 3 April

    work page 2017

Show all 17 references
  1. [11]

    5 Raffaele Santagati and others, ‘Drug Design on Quantum Computers’ (2024) 20 Nature Physics

    2024

  2. [14]

    9 Thomas Häner and Damian S Steiger, ‘0.5 Petabyte Simulation of a 45-Qubit Quantum Circuit’ , Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (2017) <http://arxiv.org/abs/1704.01127> accessed 3 April

    2017 arXiv

  3. [15]

    Footnotes 10.8 | Future research Benchmarking is an important exercise in the advancement of our understanding of quantum computing technology as it enables informed decision-making and supports the longer-term goal of standardized comparisons. Our contribution of a publicly a...

  4. [17]

    For each manufacturer, the official website was interrogated to retrieve the indicated benchmarks

    In particular, a list of known manufacturers was created based on the sources of The Quantum Insider, Olivier Ezratty, and Wikipedia. For each manufacturer, the official website was interrogated to retrieve the indicated benchmarks. For datasets not on manufacturer's websites,...

    2023

  5. [549]

    6 Rajeev Acharya and others, ‘Quantum Error Correction below the Surface Code Threshold’ (2025) 638 Nature

    2025

  6. [920]

    7 Simon J Evered and others, ‘High-Fidelity Parallel Entangling Gates on a Neutral-Atom Quantum Computer’ (2023) 622 Nature

    2023

  7. [2022]

    <https://quantuminternetalliance.org/2022/10/14/the-quantum-internet-alliance-will-build-an-advanced-european- quantum-internet-ecosystem/> accessed 31 March

    2022

  8. [2024]

    triple-nine

    Photonics and NV Center QPUs are still relatively nascent and haven’t achieved the top-performing fidelities of trapped ion and superconducting QPUs. D ata considerations This graph shows the progression of fidelity levels in new, commercially available QPUs in our dataset ove...

  9. [2025]

    play a role in US economic prosperity and national security

    Footnotes 89 | MIT INITIATIVE ON THE DIGITAL ECONOMY 9 | Quantum Networking Quantum networks are emergent communication systems that leverage the principles of quantum mechanics to transmit information in new ways. Just as the classical internet enabled email, video calls, and...

    2020

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.