Pith. sign in

REVIEW 2 major objections 5 minor 1 cited by

A calibration-aware graph reinforcement-learning router can improve simulated quantum-circuit fidelity by roughly 0.25–0.29 absolute over gate-count-driven baselines, by deliberately choosing more two-qubit gates to avoid poorly calibrated

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

A calibration-aware graph reinforcement-learning router improves exact simulated fidelity by ~0.25-0.29 over SABRE baselines on 5-8 qubit MQT Bench circuits, while 10-qubit circuits still favor SABRE.

T0 review reviewed 2026-08-02 challenge →

load-bearing objection The reported 0.25–0.29 fidelity gain is an in-sample estimate: hyperparameters and the terminal reward are tuned on the same circuits and snapshots used for final evaluation, so the headline needs held-out validation before it can be taken as predictive. the 2 major comments →

arxiv 2606.12816 v4 pith:CFJHE2TQ submitted 2026-06-11 quant-ph cs.ETcs.LG

Graph Reinforcement Learning for Calibration-Aware Quantum Circuit Routing

classification quant-ph cs.ETcs.LG
keywords calibration-aware routingquantum circuit routingreinforcement learninggraph neural networkproximal policy optimizationstate fidelitynoise-adaptive compilationSWAP routing
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that a router for quantum circuits can improve the fidelity of the final state by paying attention to same-day hardware calibration data rather than merely minimizing the number of routing operations. It trains a graph-based reinforcement-learning policy that scores hardware SWAP moves using node embeddings that include calibration quality, and tests it against established SWAP-count-minimizing heuristics on nine small benchmark circuits under a noisy simulation. The result is a large gain in simulated exact state fidelity—about 0.25 to 0.29 absolute—on 5- and 8-qubit circuits, achieved by deliberately inserting extra two-qubit gates that steer the computation away from poorly calibrated couplers. On 10-qubit circuits under a fixed tree-shaped connectivity graph, the learned policy loses to the baselines, which the paper reads as evidence that calibration-aware routing only pays off when the hardware graph offers enough alternative paths.

Core claim

On nine benchmark circuits and three same-day calibration snapshots of a superconducting processor, the learned calibration-aware router achieves a pooled mean exact simulated state fidelity of 0.727, compared with 0.440 for the SABRE-best20 baseline and 0.481 for a target-aware SABRE variant. The gains are concentrated in the 5-qubit and 8-qubit circuit families and coincide with additional routed two-qubit gates; on the fixed tree action graph used for 10-qubit circuits, every family favors SABRE-best20. The paper concludes that calibration can justify longer routes when the hardware graph provides useful alternatives, and that gate count alone is an incomplete fidelity proxy on calibrated

What carries the argument

The central object is the calibrated backend graph, whose nodes carry per-qubit calibration features (readout error, coherence, incident two-qubit error) plus placement and lookahead information from the remaining program. Two message-passing layers produce node embeddings, and a multilayer perceptron scores each legal hardware-edge SWAP from the embeddings and edge attributes; the resulting masked softmax defines the policy, trained with proximal policy optimization. The reward includes a low-cost estimated-success-probability proxy for fidelity (used during training) and a terminal term that compares the agent's proxy fidelity against a SABRE baseline's, while final evaluation uses exact d

Load-bearing premise

The entire comparison rests on the simulator's noise model faithfully representing real processor behavior; the paper does not validate the model against hardware, so the measured gains are guaranteed only in simulation.

What would settle it

Run the same compiled routes (learned and SABRE) directly on the actual 156-qubit processor using the same three calibration snapshots and measure output-state fidelity; if the learned routes do not outperform the baselines by a comparable margin on real hardware, the central claim fails. Alternatively, a simulation using a different noise model that adds crosstalk or correlated errors could reverse the ranking if the current model omits a dominant error source.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

If this is right

  • Calibration-aware routing can improve exact simulated state fidelity by roughly 0.25–0.29 absolute over gate-count-driven baselines on small circuits.
  • Fidelity gains are accompanied by measurably higher routed two-qubit counts and depth, so gate count is useful for overhead but not sufficient as a fidelity proxy.
  • The benefit depends on the action graph: under a fixed tree connectivity, 10-qubit circuits favor the baselines, implying that richer (cyclic) connectivity is needed for learned routing to help at larger scales.
  • Evaluation protocols for routing should report fidelity and calibration context alongside gate-count overhead, since routes with similar overhead can differ substantially in calibrated performance.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • If the simulated noise model transfers to real hardware, compiler default behavior could shift from gate-count minimization to calibration-aware learned routing on small-to-medium circuits with connected action graphs.
  • The 10-qubit reversal suggests a testable hypothesis: a policy trained on a cyclic hardware subgraph would recover the fidelity benefit at larger qubit counts, because the action space offers alternative paths around bad couplers.
  • The same formulation could be extended to other noise-sensitive decisions in the compilation pipeline, such as qubit layout and gate synthesis, where calibration data could similarly justify extra operations.
  • The proxy used during training (estimated success probability) is cheap but crude; a future extension could train directly with a differentiable lower bound on exact fidelity, or use a learned surrogate that is recalibrated against the exact simulator.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper proposes a calibration-aware graph reinforcement-learning router for quantum circuit routing. The policy is trained with PPO and takes as input the remaining circuit, the current placement, and same-day calibration data on a hardware graph, then selects SWAPs on calibrated edges. Training uses a low-cost proxy reward; final evaluation uses exact density-matrix fidelity with a Qiskit Aer noise model on nine MQT Bench circuits and three IBM Heron r2 calibration snapshots. The paper reports pooled mean exact fidelity of 0.727 for the learned policy versus 0.440 for SABRE-best20 and 0.481 for target-aware SABRE, with gains concentrated in 5q and 8q families and every 10q family favoring SABRE-best20 under the fixed tree action graph. The conclusion explicitly defers held-out circuits, hardware runs, and matched learned-router baselines to future work.

Significance. If the reported result holds, the paper provides a useful existence proof that calibration-aware learned routing can improve exact simulated fidelity over gate-count-driven SABRE families on small circuits, at the cost of additional two-qubit gates. The evaluation has several genuine strengths: the final metric is exact simulated fidelity rather than a proxy; comparisons are paired across three calibration snapshots with bootstrap intervals; the authors provide a code/data link; and the paper is transparent about the 10q reversal and about the need for future hardware validation. The central quantitative claim, however, is currently an in-sample estimate: hyperparameters are selected with Optuna TPE on the same nine-circuit benchmark, and the terminal reward in Eq. (2) explicitly trains the policy to beat SABRE-best20 on the same circuits and snapshots used in the final evaluation. No held-out circuit family, calibration snapshot, or independent validation set is reserved. In addition, the Qiskit Aer noise model is not validated against the real Heron r2 device, so the reported 0.25–0.29 gain may not transfer outside the simulator. The paper's significance is therefore conditional:

major comments (2)
  1. [Section III, Table I and Section IV, Table II] The hyperparameters in Table I come from a 50-trial Optuna TPE search 'followed by exact-evaluation selection' on the same nine MQT circuits and three Heron snapshots used for the final exact-fidelity evaluation. No held-out circuit family, snapshot, or independent validation set is mentioned anywhere in the protocol. Moreover, the terminal reward in Eq. (2) includes the difference between agent and SABRE-best20 proxy fidelity and cost score on the same circuits and snapshots. The policy is therefore explicitly optimized against the baseline on the evaluation distribution, and the 0.2867/0.2461 mean differences and the Wilcoxon p-values in Table II are computed on data that already shaped both the hyperparameters and the reward. These p-values do not support a predictive claim. The authors should either add a genuine held-out evaluation (e.g., held-out circuit families, held-out calibrat
  2. [Section III, noise model] The Qiskit Aer simulator uses symmetric readout error, averaged one-qubit depolarizing error, two-qubit depolarizing error clipped at 0.30, a single-coupling SWAP depolarizing channel, and thermal relaxation with clamped min(T1,T2) in [1,300] microseconds. The paper never validates this simplified noise model against real Heron r2 behavior, and the conclusion itself defers hardware runs to future work. Since the paper's abstract and introduction frame the contribution as using same-day calibration data from real IBM Heron r2 processors, the unvalidated noise model is a load-bearing limitation: the exact simulated fidelity may not reflect actual device error structure (e.g., crosstalk, temporal correlations, or calibration drift). At minimum, the authors should state clearly that all fidelity claims are about this particular simulator model, not about the real device, and they should temp
minor comments (5)
  1. [Section II, related work] The statement that published checkpoints, Heron-compatible evaluation harnesses, and action spaces differ from the present protocol is vague. Specify concretely which learned-router baselines could not be re-run and what exact differences prevented a matched comparison. This is also relevant because the paper's title says 'learned routing' but the experiments only compare against SABRE-family heuristics.
  2. [Section III, Eq. (3)] The ESP proxy definition is nonstandard: F_hat_raw is a product of per-gate success probabilities, but F_hat is computed from the geometric mean of those probabilities via (1 - clip(1 - F_raw^{1/|R|},0,1))^{|R|}. With k=1 this does not reduce to the raw product. The authors should motivate this transformation or use a simpler quantity, otherwise the proxy's 'calibration-aligned' interpretation is unclear.
  3. [Section III, benchmark protocol] The description of the ten PPO runs is ambiguous: are the same trained policy weights used across all three calibration snapshots, or is the policy retrained per snapshot? If per snapshot, specify how many training episodes are used per snapshot and whether the Optuna search is repeated. This detail is needed to understand whether the policy is actually calibration-adaptive or merely re-trained on each calibration.
  4. [Data and code availability] The GitHub link is appreciated, but for reproducibility please provide a versioned release/DOI, the exact circuit file names, the seed values, and a description of the software environment (Qiskit version, Aer version, Python versions). The current text gives only a bare URL.
  5. [Figure 1 and Figure 2] Figure 1's subfigure labels and legends are small; the distinction between the red logit and the selected SWAP edge is hard to see. In Figure 2, the bootstrap intervals are shown but their meaning (e.g., 95% over what resampling unit) is not defined in the caption. Clarify these for the reader.

Circularity Check

2 steps flagged

Headline fidelity gain is in-sample: reward shaping and hyperparameter selection use the same nine-circuit, three-snapshot benchmark that later supplies the exact-fidelity comparison.

specific steps
  1. fitted input called prediction [Section III, Eq. (2); Section IV, pooled exact-fidelity results]
    "At route completion, the terminal reward adds r_T←r_T+λ_f( F̂_A−F̂_S)−λ_c(J_A−J_S), (2) where F̂_A and F̂_S are agent and SABRE-best20 proxy fidelities for the same circuit and snapshot... Across all matched conditions, pooled mean exact fidelity is 0.7269 for the learned policy, compared with 0.4402 for SABRE-best20 and 0.4807 for target-aware SABRE."

    The policy is explicitly trained to maximize a terminal reward consisting of the proxy-fidelity advantage F̂_A−F̂_S and cost advantage J_A−J_S against SABRE-best20 on the very circuits and snapshots used for final evaluation. The reported headline is then the exact-fidelity advantage over SABRE-best20 on those same circuits. The only independent content is the gap between the ESP proxy and exact density-matrix fidelity; the comparison itself is built into the training objective, so the gain is an in-sample optimization outcome rather than an independent prediction.

  2. fitted input called prediction [Section III, hyperparameter selection; Section IV, Table II]
    "The hyperparameters in Table I come from a 50-trial Optuna tree-structured Parzen estimator (TPE) search with 300 proxy-reward episodes per trial, followed by exact-evaluation selection that covers the main PPO routing terms without repeated density-matrix evaluations."

    Hyperparameters are selected by exact-evaluation on the same nine MQT circuits and three Heron snapshots that later produce the pooled mean exact fidelity and the Wilcoxon p-values in Table II. The final ten PPO runs are then evaluated on this same benchmark. Thus the reported gain and significance are post-selection statistics on the tuning set; the evaluation data have already influenced both the reward-trained policy and the model-selection procedure, weakening the claim that the numbers measure predictive improvement.

full rationale

There is no formal derivation-chain circularity: exact simulated fidelity is computed by an independent Qiskit Aer density-matrix simulation and is not directly used as the PPO reward, so the central result is not equivalent to its inputs by construction. No self-citation chain or imported uniqueness theorem is load-bearing. However, the paper's headline comparison is partially circular as an evaluation protocol: the terminal reward explicitly includes the proxy-fidelity and cost difference versus SABRE-best20 for the same circuits and snapshots used in the final evaluation, and the hyperparameters are selected by exact-evaluation on that same benchmark. The paper itself acknowledges this limited scope by listing 'held-out circuits, hardware runs, and matched learned-router baselines' as future work. These issues make the 0.25–0.29 gain an in-sample, reward-shaped estimate rather than an independent predictive result, but they do not reduce the exact-fidelity calculation to the training objective.

Axiom & Free-Parameter Ledger

6 free parameters · 5 axioms · 0 invented entities

The central result is empirical, so the ledger is dominated by modeling choices and fitted hyperparameters. The most important are the PPO/reward hyperparameters selected on the benchmark itself, the simplified noise model, and the jittered-calibration protocol. No new physical entities are introduced.

free parameters (6)
  • PPO hyperparameters (learning_rate, gamma, GAE lambda, clip, entropy coefficient, hidden_dim, layers) = lr=3e-4, gamma=0.98, GAE lambda=0.99, clip=0.28, entropy=0.37/0.02, hidden=64, layers=2
    Selected by 50-trial Optuna TPE on proxy reward plus exact-evaluation selection; not derived from first principles.
  • Reward weights lambda_d, lambda_rho, lambda_g, lambda_s, lambda_i, lambda_f, lambda_c = 0.05, 2.0, 0.01, 0.02, 0.2, 10.0, 0.01
    Hand-set/fixed weights that shape training; the paper states these make route completion and terminal proxy fidelity carry the main signal.
  • Jitter magnitudes for evaluation calibration = 10% readout/coherence; 15% one-/two-qubit error
    Chosen by hand to create seed-specific conditions; no justification of representativeness.
  • Two-qubit depolarizing error clip = 0.30
    Modeling choice clipping calibrated 2Q error before simulation.
  • Cost score coefficient in J = 0.01 for depth tie-breaker
    Makes 2Q count primary; arbitrary scaling.
  • Coherence clamp range = min(T1,T2) clamped to [1,300] microseconds
    Simulator modeling choice.
axioms (5)
  • domain assumption Qiskit Aer noise model (symmetric readout, averaged 1Q depolarizing, clipped 2Q depolarizing, single-coupling SWAP channel, min(T1,T2) thermal relaxation) accurately represents Heron r2 for fidelity estimation.
    Section III, 'Our Qiskit Aer model uses...'; if the simplified noise model is not faithful, exact simulated fidelity may not predict hardware behavior.
  • domain assumption Jittering calibration by 10-15% per episode preserves the validity of paired same-day comparisons.
    Section III, 'Each episode jitters...'; the paper does not justify that this perturbation is representative of calibration drift.
  • ad hoc to paper The fixed 10-qubit tree action graph with nine couplers is a meaningful abstraction of Heron r2 routing constraints.
    Section III, 'we use one connected 10-qubit tree action graph...'; this choice drives the 10q reversal and limits alternatives.
  • domain assumption ESP proxy fidelity is a sufficient training signal for exact fidelity optimization.
    Section III, Eq. (3); the proxy is used for training and terminal reward, but no validation of proxy-to-exact correlation is reported.
  • standard math Standard RL/PPO convergence assumptions (GAE, clipped surrogate) apply as usual.
    PPO/GAE are standard; no special axioms.

reviewed 2026-08-02 · how reviews work

0 comments
Cite this review

Pith. "Pith review of Graph Reinforcement Learning for Calibration-Aware Quantum Circuit Routing." pith.science (2026). https://pith.science/paper/CFJHE2TQ

@misc{pith2026260612816,
  author       = {Pith},
  title        = {Pith review of: Graph Reinforcement Learning for Calibration-Aware Quantum Circuit Routing},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CFJHE2TQ}},
  note         = {Machine review of arXiv:2606.12816}
}
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Quantum circuit routing is a key step in compiling programs for noisy intermediate-scale quantum processors, particularly superconducting devices whose sparse fixed coupling makes routing a central compilation cost. Routes that appear efficient by standard overhead metrics such as SWAP count, routed two-qubit count, and depth can still lose fidelity when they pass through poorly calibrated couplers. We study a calibration-aware graph reinforcement-learning router that uses same-day calibration data from superconducting IBM Heron r2 processors to choose hardware-edge SWAPs. We train the policy with proximal policy optimization and evaluate it with exact simulated fidelity across nine Munich Quantum Toolkit (MQT) Bench circuits and three calibration snapshots. Across these evaluations, pooled mean exact fidelity is 0.727, compared with 0.440 for SWAP-based bidirectional heuristic search (SABRE)-best20 and 0.481 for target-aware SABRE. We observe that fidelity gains come with higher routed two-qubit counts and are concentrated in 5 qubit and 8 qubit circuit families; under the fixed tree action graph, all 10 qubit families favor SABRE-best20. Overall, our results show that calibration-aware learned routing can improve fidelity beyond gate-count-driven compilation, by roughly 0.25 to 0.29 in absolute mean fidelity over the SABRE-family baselines.

Figures

Figures reproduced from arXiv: 2606.12816 by Dheeraj Peddireddy, Vaneet Aggarwal, Yash Vardhan Tomar.

Figure 1
Figure 1. Figure 1: Routing-state graph construction. (a) Circuit inputs consist of the remaining circuit, front blocking gate 𝑔𝑡 , and lookahead gates 𝐺𝑡 . (b) Current non-identity placement 𝑀𝑡 : 𝐿 → 𝑃 and calibration snapshot 𝜅 are encoded on 𝐺𝐵 = (𝑃, 𝐸, 𝜅); node labels show logical occupants, and red rings mark the blocked front-gate operands. A solid 𝑝3–𝑝4 edge marks a legal SWAP edge on the shortest path. (c) Message pas… view at source ↗
Figure 2
Figure 2. Figure 2: Benchmark exact fidelity and routed two-qubit (2Q) counts. (a,b) Snapshot means with matched cells and bootstrap intervals. (c,d) Circuit-family means. Fidelity gains coincide with additional 2Q gates on families where calibration-aware routing helps. At the family level, 5q and 8q circuits improve when the router spends extra 2Q gates to avoid less reliable couplers, while 10q circuits add overhead with l… view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Shielded RL for Route-Charged Parity-Term Ordering in QEDA Phase Components

    quant-ph 2026-07 accept novelty 6.0

    Shielded RL reordering of commuting phase terms cuts routed CNOT counts by 5.7–12.2% over search baselines on parity-walk QEDA components, but the proxy does not transfer to extraction-heavy or token/permutation circuits.

Reference graph

Works this paper leans on

22 extracted references · 5 linked inside Pith · cited by 1 Pith paper

  1. [1]

    Quantum Computing in the NISQ Era and Beyond,

    J. Preskill, “Quantum Computing in the NISQ Era and Beyond,”Quantum, vol. 2, art. 79, 2018

  2. [2]

    Qubit Allocation,

    M. Y. Siraichiet al., “Qubit Allocation,”Proc. ACM Program. Lang., vol. 3, OOPSLA, 2019

  3. [3]

    Mapping Quantum Circuits to IBM QX Architectures,

    A. Zulehneret al., “Mapping Quantum Circuits to IBM QX Architectures,”IEEE TCAD, vol. 38, no. 7, pp. 1226–1236, 2019

  4. [4]

    On the Qubit Routing Problem,

    A. Cowtanet al., “On the Qubit Routing Problem,” inProc. TQC, 2019

  5. [5]

    Tackling the Qubit Mapping Problem for NISQ-Era Quantum Devices,

    G. Li, Y. Ding, and Y. Xie, “Tackling the Qubit Mapping Problem for NISQ-Era Quantum Devices,” inProc. ASPLOS, 2019

  6. [6]

    Qiskit:AnOpen-sourceFrameworkforQuantumComputing,

    Qiskitcontributors,“Qiskit:AnOpen-sourceFrameworkforQuantumComputing,” version 2.4.1, 2026

  7. [7]

    Noise-Adaptive Compiler Mappings for NISQ Computers,

    P. Muraliet al., “Noise-Adaptive Compiler Mappings for NISQ Computers,” in Proc. ASPLOS, 2019

  8. [8]

    ExtractingSuccessfromIBM’s20-QubitMachines,

    S.Nishioetal.,“ExtractingSuccessfromIBM’s20-QubitMachines,”ACMJETC, vol. 16, no. 3, 2020

  9. [9]

    EnsembleofDiverseMappings,

    S.S.TannuandM.K.Qureshi,“EnsembleofDiverseMappings,”inProc.MICRO, 2019

  10. [10]

    MQT Bench,

    N. Quetschlichet al., “MQT Bench,”Quantum, vol. 7, art. 1062, 2023

  11. [11]

    FIDDLE: Reinforcement Learning for Quantum Fidelity Enhancement,

    H. M. Ngo, T. Kahveci, and M. T. Thai, “FIDDLE: Reinforcement Learning for Quantum Fidelity Enhancement,”ACM Trans. Quantum Comput., vol. 7, no. 1, art. 7, 2026

  12. [12]

    ProximalPolicyOptimizationAlgorithms,

    J.Schulmanetal.,“ProximalPolicyOptimizationAlgorithms,”arXiv:1707.06347, 2017

  13. [13]

    NeuralMessagePassingforQuantumChemistry,

    J.Gilmeretal.,“NeuralMessagePassingforQuantumChemistry,”inProc.ICML, 2017

  14. [14]

    Semi-Supervised Classification with Graph Convolutional Networks,

    T. N. Kipf and M. Welling, “Semi-Supervised Classification with Graph Convolutional Networks,” inProc. ICLR, 2017

  15. [15]

    Reinforcement Learning for Qubit Routing,

    M. G. Pozziet al., “Reinforcement Learning for Qubit Routing,”ACM Trans. Quantum Comput., vol. 3, no. 2, 2022

  16. [16]

    Qubit Routing Using GNN-Aided MCTS,

    A. Sinha, U. Azad, and H. Singh, “Qubit Routing Using GNN-Aided MCTS,” in Proc. AAAI, 2022

  17. [17]

    DeepRLStrategiesforNoise-Adaptive Qubit Routing,

    G.Pascoal,J.P.Fernandes,andR.Abreu,“DeepRLStrategiesforNoise-Adaptive Qubit Routing,” inProc. IEEE QSW, pp. 146–156, 2024

  18. [18]

    AlphaRouter,

    W. Tanget al., “AlphaRouter,” arXiv:2410.05115, 2024

  19. [19]

    Noise-Adaptive Mapping with GNNs,

    V. Saravanan and S. M. Saeed, “Noise-Adaptive Mapping with GNNs,”IEEE TCAD, 2024

  20. [20]

    H. T. Nguyenet al., “QFOR,” arXiv:2508.04974, 2025

  21. [21]

    Improving and Benchmarking NISQ Qubit Routers,

    V. Pina-Canelles, A. Auer, and I. de Vega, “Improving and Benchmarking NISQ Qubit Routers,” arXiv:2502.03908, 2025

  22. [22]

    Qubit Mapping and Routing Tailored to Advanced Quantum ISAs: Not as Costly as You Think,

    Z. Yanget al., “Qubit Mapping and Routing Tailored to Advanced Quantum ISAs: Not as Costly as You Think,” arXiv:2511.04608, 2025

This paper was first reviewed by deepseek-v4-flash on August 2, 2026.