REVIEW 4 major objections 6 minor 33 references
Personalized Improvement of Standard Readout Error Mitigation using Low-Depth Circuits and Machine Learning
T0 review · 4 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper proposes a machine-learning update to the standard readout error confusion matrix, trained on low-depth random circuits, and reports median gains of 6.6% in fidelity, 29.9% in mean-squared error, and 10.3% in Hellinger distance…
desk verdict The reader's rank-1 objection to Eq. (22) is mathematically wrong; the paper's real weakness is that it omits shot counts, error bars, and code, making the modest reported gains impossible to evaluate. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the per-qubit readout error matrix $Q_i$, a $2\times 2$ confusion matrix whose entry $Q_{i,(j,k)}$ is the probability that qubit $i$ is measured as $j$ when prepared as $k$. The mechanism that carries the argument is an ordinary least squares update: for each qubit $i$ and each measured outcome $m \in \{0,1\}$, the design matrix $X_i$ stacks the ideal per-qubit probability vectors $q_{i,k} = [P(|0\rangle), P(|1\rangle)]^T$ across the training circuits, and the target $\bar{y}_{i,m}$ stacks the corresponding noisy probabilities; the regression weights $w_{i,m} = (X_i^T X_i)^{-1} X_i^T \bar{y}_{i,m}$ are then combined with the original $Q_i$ as $Q_i^* = c((1-\eta)Q_i + \eta [w_{i,0}, w_{i,1}])$, normalized by $c$, and used to assemble an updated full error matrix $E^*$ whose inverse is the personalized mitigation matrix. This update is what lets the readout model track the device's current behavior, and the matrix inversion step then applies the same standard mitigation protocol to the personalized model.
What would settle it
Compute $X_i^T X_i$ for any qubit's training data: because each row sums to one, the matrix has rank one and determinant zero, so the closed-form inverse in Eq. (22) does not exist. Running the training procedure with two different pseudo-inverse conventions on the same data would produce different $w_{i,m}$, different $Q_i^*$, and different mitigated distributions, showing that the reported improvements are implementation-dependent.
Extended reading notes
Core claim
Standard readout error mitigation constructs a per-qubit confusion matrix $Q_i$ from calibration circuits that prepare all-$|0\cdots 0\rangle$ and all-$|1\cdots 1\rangle$ states, builds the full $2^n \times 2^n$ error matrix $E$ under an independence assumption, and mitigates by inverting $E$. The paper's claim is that this matrix can be sharpened by collecting noisy measurement distributions from many random low-depth circuits and, for each qubit, regressing the measured probabilities $\bar{q}_{i,k}$ on the ideal probabilities $q_{i,k}$; the resulting regression weights $w_{i,m}$ are blended with the original $Q_i$ through a learning rate $\eta$, giving an updated $Q_i^*$, an updated $E^*$, and a personalized mitigation matrix $(E^*)^{-1}$. Tested on a simulated seven-qubit backend with depth-four training circuits, the personalized matrix outperforms standard mitigation on all three reported metrics, with 78%, 85%, and 91% of the 100 test circuits improving in fidelity, mean-squared error, and Hellinger distance, respectively.
Load-bearing premise
The load-bearing premise is that each qubit's least-squares regression update has a unique closed-form solution, but the two regressors — the probabilities of measuring $|0\rangle$ and $|1\rangle$ — always sum to one, so the matrix $(X_i^T X_i)$ is singular and the solution depends on an unspecified pseudo-inverse or regularization.
Editorial extensions
If this is right
- The standard readout error matrix can be re-trained on low-depth circuits, so mitigation can track gate-set and calibration drift without repeating full $2^n$-state detector tomography.
- On the tested backend, the improvement over standard mitigation persists for circuit depths from one to ten, so the personalization is not tied to a single training depth.
- The method is limited to circuits whose useful output is captured by measurement-outcome magnitudes with positive, real coefficients; states with sign or phase information would require exponentially costly reconstruction.
- Because small negative entries are dropped and the remaining vector renormalized, the post-processing assumes sparse output distributions; dense distributions would require exponentially more samples.
Reading between the lines
- The regression's normal matrix $X_i^T X_i$ is singular for any training set, so the reported PEM matrix depends on the regression implementation's implicit pseudo-inverse; the improvement is not uniquely defined until that choice is specified.
- A regularized or otherwise constrained update to $Q_i$ would make the personalization well-posed and could be benchmarked against the paper's numbers.
- The same per-qubit regression update could in principle tune Bayesian unfolding or other mitigation strategies, not just matrix inversion.
- The sparse-distribution assumption suggests the method's advantage may shrink on circuits that produce dense output distributions, a testable extension the paper leaves open.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes 'personalized error mitigation' (PEM), a modification of standard readout error mitigation. Standard EM estimates a per-qubit readout error matrix Q_i from circuits preparing all |0...0> and |1...1>, constructs a full confusion matrix E, and inverts it. PEM additionally generates N random low-depth training circuits, uses ordinary least squares to regress measured outcome probabilities for each qubit on the ideal probabilities, and blends the resulting weights with the original Q_i through a learning rate eta, yielding an updated matrix E* that is then inverted. The authors evaluate PEM on the Qiskit Fake Perth simulator for n = 7 qubits and report median improvements over standard EM of 6.6% in fidelity, 29.9% in MSE, and 10.3% in Hellinger distance on 100 held-out depth-4 circuits, plus a depth-scaling study. The central regression step is, for generic random training circuits, mathematically well-posed, although the manuscript's justification is incomplete.
Significance. If the reported gains are real and reproducible, PEM would be a simple, low-overhead improvement to a standard readout mitigation pipeline, and the idea of using low-depth circuit statistics to refine a confusion matrix is worth exploring. The method's strength is its simplicity: the OLS update is standard and the training circuits are easy to generate. However, the paper currently lacks the experimental details needed to assess or reproduce the claim: the number of shots is never stated, no code is provided, and the reported medians come without error bars or significance tests. These omissions are load-bearing because the measured probabilities are frequency estimates with sampling noise, and the improvement could in principle be an artifact of that noise. The manuscript is also honest about known limitations (sparse distributions, exponential scaling), which is to its credit.
major comments (4)
- [Sec. 2.3, Sec. 3.3, Tables 1-2] The manuscript never states the number of shots s used to estimate Q_i (Eqs. (11)-(14)) or the per-circuit shot count used to obtain the training targets ybar_i,m and the test probability vectors. All of these quantities are frequencies, so every entry of Q_i, every row of X_i, and every test vector carries sampling variance. Without s, the claimed median improvements in Table 2 and the depth scaling in Fig. 7 cannot be reproduced, and they cannot be distinguished from the effect of PEM smoothing sampling noise rather than improving the error model. This is the most important omission and should be fixed by reporting s and, ideally, the noise model's parameters.
- [Sec. 3.2, Sec. 3.3, Fig. 6, Fig. 7, Table 2] The headline results are point estimates of median improvement over 100 test circuits, with no confidence intervals, error bars, or significance tests. Fig. 6 shows that a substantial fraction of circuits are better under standard EM (22% for fidelity, 15% for MSE, 9% for Hellinger), so the median improvement could be consistent with sampling fluctuations. The eta-selection plot in Fig. 3 and the quadratic fit in Eq. (27) also lack error bars, even though the underlying MSE values are estimated from 50 circuits. Please provide bootstrap or confidence intervals and a paired significance test (e.g., Wilcoxon signed-rank) for the three metrics.
- [Sec. 2.5, Eq. (23), Sec. 2.6] The PEM algorithm is not fully specified. In Eq. (23), c is described only as 'some normalization constant,' and the post-processing step that 'drops small-magnitude, negative entries' does not define the threshold. The paper says code was written in Python but gives no repository or release. Because the method is defined by these implementation details, a reader cannot reconstruct E* from the text. Please specify c and the clipping rule, and make the code (or at least a pseudocode listing) available.
- [Sec. 2.6, Sec. 3.3, Fig. 7] The training and test circuits are sampled from the same random distribution (n = 7, depth 4, and varying depths in Fig. 7), so the holdout evaluation shows generalization to new circuits of the same family, not personalization to a distinct gate set or to a different calibration period. The introduction motivates PEM as accounting for 'the entire gate set' and calibration drift, but no experiment varies the gate set or the time since calibration. Please either temper the claim or add an evaluation on circuits with a different gate distribution and on noise-model drift.
minor comments (6)
- [Sec. 2.1, Eq. (5)] The equation P(|j>) = <j|psi> = |alpha_j|^2 should read P(|j>) = |<j|psi>|^2 = |alpha_j|^2; the inner product <j|psi> is alpha_j, not a probability.
- [Sec. 2.4] The reference to 'Equation 2.2' should be to Eq. (9), and the statement about (E E_m)^T is confusing; clarifying that E_m = E^{-1} gives E_m^T E^T = I would make the mitigation step unambiguous.
- [Sec. 2.5, Eq. (22)] The justification for invertibility is incomplete: the conditions 'N > 2' and 'X_i nonzero' do not guarantee that X_i^T X_i is invertible. The correct condition is that the training probabilities P(|0>) are not constant across circuits, since det(X_i^T X_i) = N * sum(p^2) - (sum(p))^2, which is positive for nonconstant p. This condition is presumably satisfied by the random training circuits, but it should be stated.
- [Sec. 2.3 vs. Sec. 2.6] Section 2.3 says circuits are run 'on real hardware,' while Section 2.6 states that the Fake Perth simulator is used; please make the hardware/simulator distinction consistent throughout.
- [Table 1] The MSE entry '0.005.32 x 10^-3' appears to be a formatting error; it should be a single number.
- [Sec. 2.4] The phrase 'randomized lower-upper (LU) decomposition' is unusual because LU decomposition is normally deterministic; if a randomized solver was used, it should be described explicitly.
Circularity Check
No significant circularity: the PEM matrix is fit on training circuits and evaluated on separate held-out-style test circuits, with no self-citation or definitional reduction.
full rationale
The paper's derivation chain is empirical and not circular. Section 2.5 fits the per-qubit error rows w_i,m by ordinary least squares to a training set T of N random low-depth circuits, using features X_i = ideal probabilities and targets ybar_i,m = noisy measured probabilities (Eqs. 16-22); the reported improvements in Tables 1-2 and Figure 7 are computed on test circuits described as 'randomly selected' after training, so the comparison is a generalization evaluation rather than a restatement of the training objective. Eq. (23) updates Q_i with a convex combination of the initial two-circuit estimate and the regression weights, but the update is not defined in terms of the evaluation metrics (fidelity, MSE over the full 2^n distribution, Hellinger distance) nor in terms of the test-set outcomes. The paper contains no self-citations, no imported uniqueness theorem, and no ansatz smuggled in via prior work: the linear readout model is stated in Eqs. (8)-(10) and (17) from measurement probability definitions, and the ML-QEM-related prior work [15] is cited as background rather than as justification for the personalization step. An initial concern about the singularity of X_i^T X_i is unfounded because the row dependence (each row sums to one) does not make the 2x2 Gram matrix singular for non-constant training features. The lack of stated shot counts and code availability is a reproducibility or statistical-validity issue, not a circularity issue; likewise the reported advantage possibly reflecting distribution matching is a possible bias in generalization claims but not a definitional reduction. Therefore no circular step can be exhibited, and the score is 0.
Assumptions & free parameters
free parameters (4)
- learning rate eta =
0.23
- regression weights w_i,m =
not reported
- normalization constant c =
not reported
- number of shots s =
not reported
assumptions (5)
- domain assumption Assumption 1: measured and prepared states are random variables
- domain assumption Assumption 2: readout errors are independent across qubits
- domain assumption Assumption 3: E is diagonally dominant
- ad hoc to paper The normal matrix X_i^T X_i is invertible
- domain assumption Fake Perth simulator faithfully represents IBM Perth noise
Cite this review
Pith. "Pith review of Personalized Improvement of Standard Readout Error Mitigation using Low-Depth Circuits and Machine Learning." pith.science (2026). https://pith.science/paper/UZDA2BKE
@misc{pith2026250603920,
author = {Pith},
title = {Pith review of: Personalized Improvement of Standard Readout Error Mitigation using Low-Depth Circuits and Machine Learning},
year = {2026},
howpublished = {\url{https://pith.science/paper/UZDA2BKE}},
note = {Machine review of arXiv:2506.03920}
}
read the original abstract
Quantum computers have shown promise in improving algorithms in a variety of fields. The realization of these advancements is limited by the presence of noise and high error rates, which become prominent especially with increasing system size. Mitigation techniques using matrix inversions, unfolding, and deep learning, among others, have been leveraged to reduce this error. However, these methods are not reflective of the entire gate set of the quantum device and may need further tuning depending on the distance from the most recent calibration time. This paper proposes a method of improvement to numerical readout error techniques, where the readout error model is further refined using measured probability distributions from a collection of low-depth circuits. We use machine learning to improve the readout error model for the quantum system, testing the circuits on the simulated IBM Perth backend using Qiskit. We demonstrate a median 6.6% improvement in fidelity, 29.9% improvement for mean-squared error, and 10.3% improvement in Hellinger distance over the standard error mitigation approach for a seven-qubit system with a circuit depth of four. With further focus directed towards such improvement of these error mitigation techniques, we are one step closer to the fault-tolerant quantum computing era.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Mitigation of correlated readout errors without randomized measurements
aasen2025mitigation APACrefauthors Aasen, A S. , Di Giovanni, A. , Rotzinger, H. , Ustinov, A V. \ G\" a rttner, M. APACrefauthors \ 2025 . Mitigation of correlated readout errors without randomized measurements Mitigation of correlated readout errors without randomized measurements . arXiv preprint arXiv:2503.24276
work page Pith review arXiv 2025
-
[2]
aharonov2023polynomial APACrefauthors Aharonov, D. , Gao, X. , Landau, Z. , Liu, Y. \ Vazirani, U. APACrefauthors \ 2023 . A polynomial-time classical algorithm for noisy random circuit sampling A polynomial-time classical algorithm for noisy random circuit sampling . Proceedings of the 55th Annual ACM Symposium on Theory of Computing Proceedings of the 5...
work page 2023
-
[3]
arute2019quantum APACrefauthors Arute, F. , Arya, K. , Babbush, R. , Bacon, D. , Bardin, J C. , Barends, R. others APACrefauthors \ 2019 . Quantum supremacy using a programmable superconducting processor Quantum supremacy using a programmable superconducting processor . Nature 574 7779 505--510
work page 2019
-
[4]
betancourt2007parallel APACrefauthors Betancourt, R. \ Alvarado, F L. APACrefauthors \ 2007 . Parallel inversion of sparse matrices. Parallel inversion of sparse matrices. IEEE transactions on power systems 1 1 74--81
work page 2007
-
[5]
bittel2021training APACrefauthors Bittel, L. \ Kliesch, M. APACrefauthors \ 2021 . Training variational quantum algorithms is NP-hard Training variational quantum algorithms is np-hard . Physical review letters 127 12 120502
work page 2021
-
[6]
bonet2023performance APACrefauthors Bonet-Monroig, X. , Wang, H. , Vermetten, D. , Senjean, B. , Moussa, C. , B \"a ck, T. O'Brien, T E. APACrefauthors \ 2023 . Performance comparison of optimization methods on variational quantum algorithms Performance comparison of optimization methods on variational quantum algorithms . Physical Review A 107 3 032407
work page 2023
-
[7]
cerezo2021variational APACrefauthors Cerezo, M. , Arrasmith, A. , Babbush, R. , Benjamin, S C. , Endo, S. , Fujii, K. others APACrefauthors \ 2021 . Variational quantum algorithms Variational quantum algorithms . Nature Reviews Physics 3 9 625--644
work page 2021
-
[8]
cerfontaine2020self APACrefauthors Cerfontaine, P. , Otten, R. \ Bluhm, H. APACrefauthors \ 2020 . Self-consistent calibration of quantum-gate sets Self-consistent calibration of quantum-gate sets . Physical Review Applied 13 4 044071
work page 2020
Show all 33 references
-
[9]
, Marvian, M
de2023limitations APACrefauthors De Palma, G. , Marvian, M. , Rouz \'e , C. \ Fran c a, D S. APACrefauthors \ 2023 . Limitations of variational quantum algorithms: a quantum optimal transport approach Limitations of variational quantum algorithms: a quantum optimal transport a...
2023
-
[10]
APACrefauthors \ 2017
de2017potential APACrefauthors De Wolf, R. APACrefauthors \ 2017 . The potential impact of quantum computers on society The potential impact of quantum computers on society . Ethics and Information Technology 19 271--276
2017
-
[11]
, Liu, G
fan2025calibrating APACrefauthors Fan, D. , Liu, G. , Li, S. , Gong, M. , Wu, D. , Zhang, Y. others APACrefauthors \ 2025 . Calibrating quantum gates up to 52 qubits in a superconducting processor Calibrating quantum gates up to 52 qubits in a superconducting processor . npj Q...
2025
-
[12]
, Goldstone, J
farhi2014quantum APACrefauthors Farhi, E. , Goldstone, J. \ Gutmann, S. APACrefauthors \ 2014 . A quantum approximate optimization algorithm A quantum approximate optimization algorithm . arXiv preprint arXiv:1411.4028
2014 arXiv
-
[13]
, Treinish, M
javadi2024quantum APACrefauthors Javadi-Abhari, A. , Treinish, M. , Krsulich, K. , Wood, C J. , Lishman, J. , Gacon, J. others APACrefauthors \ 2024 . Quantum computing with Q iskit Quantum computing with Q iskit . arXiv preprint arXiv:2405.08810
2024 arXiv
-
[14]
kim2022quantum APACrefauthors Kim, J. , Oh, B. , Chong, Y. , Hwang, E. \ Park, D K. APACrefauthors \ 2022 . Quantum readout error mitigation via deep learning Quantum readout error mitigation via deep learning . New Journal of Physics 24 7 073009
2022
-
[15]
, Wang, D S
liao2024machine APACrefauthors Liao, H. , Wang, D S. , Sitdikov, I. , Salcedo, C. , Seif, A. \ Minev, Z K. APACrefauthors \ 2024 . Machine learning for practical quantum error mitigation Machine learning for practical quantum error mitigation . Nature Machine Intelligence 1--9
2024
-
[16]
, Veps \"a l \"a inen, A
lienhard2022deep APACrefauthors Lienhard, B. , Veps \"a l \"a inen, A. , Govia, L C. , Hoffer, C R. , Qiu, J Y. , Rist \`e , D. others APACrefauthors \ 2022 . Deep-neural-network discrimination of multiplexed superconducting-qubit states Deep-neural-network discrimination of m...
2022
-
[17]
, Joo, J
lubasch2020variational APACrefauthors Lubasch, M. , Joo, J. , Moinier, P. , Kiffner, M. \ Jaksch, D. APACrefauthors \ 2020 . Variational quantum algorithms for nonlinear problems Variational quantum algorithms for nonlinear problems . Physical Review A 101 1 010301
2020
-
[18]
, Zimbor \'a s, Z
maciejewski2020mitigation APACrefauthors Maciejewski, F B. , Zimbor \'a s, Z. \ Oszmaniec, M. APACrefauthors \ 2020 . Mitigation of readout noise in near-term quantum devices by classical post-processing based on detector tomography Mitigation of readout noise in near-term qua...
2020
-
[19]
, Niroula, P
maksymov2021optimal APACrefauthors Maksymov, A. , Niroula, P. \ Nam, Y. APACrefauthors \ 2021 . Optimal calibration of gates in trapped-ion quantum computers Optimal calibration of gates in trapped-ion quantum computers . Quantum Science and Technology 6 3 034009
2021
-
[20]
, Vishi, K
mavroeidis2018impact APACrefauthors Mavroeidis, V. , Vishi, K. , Zych, M D. \ J sang, A. APACrefauthors \ 2018 . The impact of quantum computing on present cryptography The impact of quantum computing on present cryptography . arXiv preprint arXiv:1804.00200
2018 arXiv
-
[21]
\ Vuik, C
moller2017impact APACrefauthors M \"o ller, M. \ Vuik, C. APACrefauthors \ 2017 . On the impact of quantum computing technology on future developments in high-performance scientific computing On the impact of quantum computing technology on future developments in high-performa...
2017
-
[22]
, Urbanek, M
nachman2020unfolding APACrefauthors Nachman, B. , Urbanek, M. , de Jong, W A. \ Bauer, C W. APACrefauthors \ 2020 . Unfolding quantum computer readout noise Unfolding quantum computer readout noise . npj Quantum Information 6 1 84
2020
-
[23]
, Kang, H
nation2021scalable APACrefauthors Nation, P D. , Kang, H. , Sundaresan, N. \ Gambetta, J M. APACrefauthors \ 2021 . Scalable mitigation of measurement errors on quantum computers Scalable mitigation of measurement errors on quantum computers . PRX Quantum 2 4 040326
2021
-
[24]
, Chen, K
pan2022solving APACrefauthors Pan, F. , Chen, K. \ Zhang, P. APACrefauthors \ 2022 . Solving the sampling problem of the sycamore quantum circuits Solving the sampling problem of the sycamore quantum circuits . Physical Review Letters 129 9 090502
2022
-
[25]
, Srinivasan, S
pokharel2024scalable APACrefauthors Pokharel, B. , Srinivasan, S. , Quiroz, G. \ Boots, B. APACrefauthors \ 2024 . Scalable measurement error mitigation via iterative B ayesian unfolding Scalable measurement error mitigation via iterative B ayesian unfolding . Physical Review ...
2024
-
[26]
APACrefauthors \ 2019
preskill2019quantum APACrefauthors Preskill, J. APACrefauthors \ 2019 . Quantum computing in the NISQ era and beyond Quantum computing in the NISQ era and beyond . Bulletin of the American Physical Society 64 9
2019
-
[27]
, Mehra, N
rawat2022quantum APACrefauthors Rawat, B. , Mehra, N. , Bist, A S. , Yusup, M. \ Sanjaya, Y P A. APACrefauthors \ 2022 . Quantum computing and AI : Impacts & possibilities Quantum computing and AI : Impacts & possibilities . ADI Journal on Recent Innovation 3 2 202--207
2022
-
[28]
\ Karpuzcu, U R
resch2021benchmarking APACrefauthors Resch, S. \ Karpuzcu, U R. APACrefauthors \ 2021 . Benchmarking quantum computers and the impact of quantum noise Benchmarking quantum computers and the impact of quantum noise . ACM Computing Surveys (CSUR) 54 7 1--35
2021
-
[29]
, Alam, M
saki2021impact APACrefauthors Saki, A A. , Alam, M. \ Ghosh, S. APACrefauthors \ 2021 . Impact of noise on the resilience and the security of quantum computing Impact of noise on the resilience and the security of quantum computing . 2021 22nd International Symposium on Qualit...
2021
-
[30]
\ Garcia-Patron, R
stilck2021limitations APACrefauthors Stilck Fran c a, D. \ Garcia-Patron, R. APACrefauthors \ 2021 . Limitations of optimization algorithms on noisy quantum devices Limitations of optimization algorithms on noisy quantum devices . Nature Physics 17 11 1221--1227
2021
-
[31]
\ Zhang, C H
sun2013sparse APACrefauthors Sun, T. \ Zhang, C H. APACrefauthors \ 2013 . Sparse matrix inversion with scaled L asso Sparse matrix inversion with scaled L asso . The Journal of Machine Learning Research 14 1 3385--3418
2013
-
[32]
, Het \'e nyi, B
svastits2025readout APACrefauthors Svastits, D. , Het \'e nyi, B. , Sz \'e chenyi, G. , Wootton, J. , Loss, D. , Bosco, S. \ P \'a lyi, A. APACrefauthors \ 2025 . Readout sweet spots for spin qubits with strong spin-orbit interaction Readout sweet spots for spin qubits with st...
2025 arXiv
-
[33]
, Raymond, R
yang2022efficient APACrefauthors Yang, B. , Raymond, R. \ Uno, S. APACrefauthors \ 2022 . Efficient quantum readout-error mitigation for sparse measurement outcomes of near-term quantum devices Efficient quantum readout-error mitigation for sparse measurement outcomes of near-...
2022
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.