REVIEW 3 major objections 3 minor 1 cited by
Excluding underperforming components from a 120-qubit superconducting array cuts logical errors by up to 2.8 times in distance-5 surface codes.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-15 07:34 UTC pith:LIR44PHY
load-bearing objection Clean experimental head-to-head on 120 superconducting qubits shows defect exclusion beats both ignoring defects and defect-aware decoding for d=5 surface codes; abstract-only so the numbers still need full-text audit. the 3 major comments →
Error correction on an array of superconducting qubits with defective components
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
On a 120-qubit superconducting square-lattice array, excluding experimentally identified underperforming components from distance-5 surface codes produces up to a 2.8-fold reduction in logical errors per round for memory (1.62 percent versus 4.49 percent for the defect-ignorant baseline) and restores 6.3 percent per-round failure-rate suppression in stability experiments for measurement-based logic, whereas defect-aware decoding alone gives only modest gains; leakage post-selection further improves performance so that distance-5 can outperform the best distance-3 code in one basis.
What carries the argument
Defect-exclusion strategies for the surface code: the code layout is adapted to omit underperforming qubits and couplers identified by device characterization, thereby preserving high-performance connectivity for both memory and measurement-based logical operations.
Load-bearing premise
The experimental characterization correctly labels which components are underperforming, and excluding them does not introduce unaccounted correlated errors or connectivity artifacts that would reverse the gains on larger or differently fabricated devices.
What would settle it
A repeated distance-5 memory or stability experiment on the same or a comparable array in which the labeled defective components remain in the code (or a different set is excluded) that fails to reproduce the 2.8-fold logical-error reduction or the 6.3 percent per-round stability suppression.
If this is right
- Logical memory error rates on defective superconducting arrays fall substantially when the code layout is adapted rather than relying on decoder-only fixes.
- Measurement-based logical operations regain multi-round stability once defects are excluded.
- Leakage post-selection combined with exclusion can make a higher-distance code outperform the best lower-distance code even in the presence of fabrication defects.
- Scale-up of solid-state quantum computers will require routine defect mapping and code reconfiguration as a standard procedure.
Where Pith is reading between the lines
- Comparable exclusion strategies are likely to be required on other solid-state platforms (spin qubits, photonic lattices) where fabrication variance is unavoidable.
- Device yield targets can be relaxed if reliable post-fabrication code reconfiguration is available, shifting the engineering emphasis from perfect fabrication to accurate defect characterization.
- Automated defect-aware compilers will become necessary for larger-distance codes to keep the overhead of exclusion manageable.
- Residual correlations introduced by the altered connectivity after exclusion should be quantified, as they may ultimately limit further gains.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript reports an experimental comparison of three operational strategies for distance-5 surface codes on a 120-qubit square-lattice superconducting processor in the presence of underperforming components: (i) a defect-ignorant baseline, (ii) defect-aware decoding, and (iii) exclusion of defective components from the code. In a memory experiment the authors report up to a 2.8× reduction in logical error per round when excluding defects (1.62% versus 4.49% for the defect-ignorant baseline), with only modest gains from defect-aware decoding. In a stability experiment intended to probe measurement-based logical operations, defect exclusion is reported to yield a 6.3% per-round failure-rate suppression where none is observed otherwise. Combining defect exclusion with leakage post-selection is further claimed to make a distance-5 code outperform the best distance-3 code in one basis, presented as a proof-of-principle for defect exclusion in solid-state scale-up.
Significance. If the reported gains survive full methodological and statistical scrutiny, the work would be a useful experimental demonstration that defect exclusion can substantially outperform both ignoring defects and informing the decoder alone, for both memory and measurement-based logic on a large superconducting array. That comparison is practically relevant for solid-state architectures where fabrication variation is expected. The abstract also credits a concrete multi-strategy experimental design on a 120-qubit device and a combined leakage-post-selection result; those are strengths if the full data and analysis support them. Significance remains conditional on verification of the defect-labeling pipeline, connectivity after exclusion, and the statistical robustness of the quoted percentages.
major comments (3)
- Abstract (central quantitative claims): The load-bearing results—2.8× logical-error reduction for d=5 memory (1.62% vs 4.49%) and 6.3% per-round failure-rate suppression in the stability experiment—cannot be audited from the abstract alone. A full review requires the defect-identification criteria, characterization fidelity, shot counts, error bars, and any multi-run or multi-device statistics. Without those, selection bias, run-to-run drift, or post-hoc labeling against the same logical-error metric cannot be ruled out, and the proof-of-principle claim remains conditional.
- Abstract (defect exclusion vs. lattice integrity): The claim that excluding underperforming components resurrects measurement-based logic performance assumes that removal preserves the required surface-code connectivity and does not inject new correlated errors at cut boundaries. The abstract does not state how the reduced lattice is defined, whether the same defect set is used consistently across memory and stability runs, or how boundary artifacts are controlled. This is load-bearing for interpreting the 6.3% suppression as a genuine benefit of exclusion rather than a connectivity artifact.
- Abstract (strategy comparison): The three-way comparison (defect-ignorant, defect-aware decoding, exclusion) is the paper’s central experimental design. The abstract does not define the defect-aware decoder (what information is passed, how defects are modeled in the matching graph) or confirm that defect labels were fixed before logical-error evaluation. If labels or decoder hyperparameters were tuned on the same metric used for the headline ratios, the reported gains would not be independent evidence of strategy superiority.
minor comments (3)
- Abstract: The terms “underperforming,” “defective,” and “defects” are used interchangeably; a precise operational definition (threshold on T1/T2, readout fidelity, coupler strength, etc.) should be stated early in the full text and applied uniformly.
- Abstract: “Up to 2.8X improvement” and “6.3% per-round suppression” should be accompanied, in the full manuscript, by the basis (X/Z), number of rounds, and whether the figures are per-round logical error rates or cumulative failure probabilities, to avoid ambiguity when comparing to other surface-code experiments.
- Abstract: The claim that a distance-5 code “outperforms the best distance-3 in one basis” under leakage post-selection needs an explicit statement of which basis and which distance-3 baseline (same device region or best available) so the comparison is reproducible.
Circularity Check
No circularity: experimental comparison of measured logical-error rates under three operational strategies; abstract reports device outcomes, not fitted predictions or self-definitional derivations.
full rationale
Only the abstract is available. It describes an experimental comparison on a 120-qubit superconducting array: distance-5 surface-code memory and stability experiments run under three strategies (defect-ignorant baseline, defect-aware decoding, and defect exclusion). The reported quantities (1.62% vs 4.49% logical errors per round; 6.3% per-round failure-rate suppression; further gains with leakage post-selection) are measured outcomes of those runs, not quantities derived from parameters fitted to the same data and then re-presented as predictions. No equations, uniqueness theorems, ansatzes, or self-citations appear in the abstract that would close a definitional loop. The reader’s minor residual concern (possible post-hoc tuning of defect labels against the logical-error metric) is an experimental-methodology risk, not a circularity of the kind enumerated in the analyzer rules; without full text it cannot be exhibited by quote-and-reduction. Consequently the derivation chain is self-contained against external benchmarks (device measurements) and scores 0.
Axiom & Free-Parameter Ledger
axioms (3)
- domain assumption Surface-code distance and stabilizer structure remain valid when a subset of qubits/couplers is removed or deactivated.
- domain assumption Underperforming components can be identified by pre-characterization sufficiently accurately that exclusion improves logical performance.
- domain assumption Standard superconducting-qubit noise and leakage models apply to the 120-qubit array.
read the original abstract
A solid-state quantum-computing architecture will require the fabrication of arrays of many coupled qubits. It is inevitable that this process will produce qubits and couplers with varying performance, with some components underperforming due to imperfect fabrication. Quantum error-correction requires high-performing components and hence these defects must be dealt with, either by adapting the code to exclude the defects, or by informing the decoder to accommodate defects in post-processing. Here we implement and compare strategies to operate distance-5 surface codes on a quantum processor consisting of a square-lattice array of 120 superconducting qubits. We demonstrate a dramatic reduction in the probability of a logical error in a memory experiment by excluding underperforming components, compared with both a standard approach of ignoring defects, and a defect-aware decoding approach. We observe up to 2.8X improvement in logical errors per round when excluding defects compared with the standard defect-ignorant approach (1.62% compared to 4.49%). In contrast, defect-aware decoding gives only modest gains. Defects are also expected to be particularly harmful for measurement-based logical operations. Using a stability experiment we show that excluding defects resurrects measurement-based logic gate performance, observing a 6.3% per-round suppression of failure rate when excluding defects, compared to zero suppression otherwise. Furthermore, we show a further substantial decrease in logical errors when using leakage post-selection in combination with our defect exclusion strategies, resulting in a distance-5 code outperforming the best distance-3 in one basis. Our experiments therefore give a proof-of-principle demonstration of the essential utility of defect exclusion methods in the scale-up of solid-state quantum computing approaches.
Forward citations
Cited by 1 Pith paper
-
A route to damage tolerance exceeding $10\%$ in shuttling-equipped quantum processors
Shuttling-based spin-qubit surface codes retain roughly half their effective code distance at 10% hardware damage, so oversizing by ~2x can compensate.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.