REVIEW 5 major objections 5 minor 35 references
Reinforcement Learning Enhanced Greedy Decoding for Quantum Stabilizer Codes over $\mathbb{F}_q$
T0 review · 5 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A Hermitian curve over F_3 yields a [[27,13,4]]_3 qutrit stabilizer code, and an RL-on-Greedy decoder cuts logical failures from about 8 percent to about 0.5 percent.
desk verdict The claimed [[27,13,4]]_3 code is unsupported: Section 3 builds on the wrong curve and an inconsistent divisor, so the decoder benchmark is unanchored. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is the one-point algebraic-geometry code on a separated-polynomial curve, together with the monomial basis claimed in Lemma 3.1, $\{x^i y^j : i\ge 0,\ 0\le j\le q-1,\ iq+j(q-1)\le r\}$, and the Hermitian self-orthogonality condition $2r\le q^3+q^2-3q$ that lets the nonbinary stabilizer-code lemma convert $C_r$ into a quantum code. The decoding machinery is the two-stage RL-on-Greedy algorithm: greedily flip qudits to reduce syndrome weight, then let a deep Q-network act on whatever residual syndrome remains, with actions and syndrome values taken in $\mathbb{F}_q$.
What would settle it
For $q=3$ and $r=7$, count the monomials in Lemma 3.1 under its own inequality: $i\cdot3+j\cdot2\le 7$ has 7 solutions, while the Riemann-Roch dimension of $L(49P_\infty)$ on $y^3+y=x^4$ is 47; recomputing the code dimension directly from $C_L(D,G)$, or checking whether the function $t$ with divisor $G-r(q^2-q+1)P_\infty$ exists, would settle which side is right.
Extended reading notes
Core claim
The central discovery on the code side is a parameterized family: take $X:y^q+y=x^m$ with $q-m=1$, let $D$ be the sum of $\mathbb{F}_{q^2}$-rational points outside a chosen set $G$, and set $G=r(q^2-q+1)P_\infty$; the paper claims the code $C_r=C_L(D,G)$ is monomially equivalent to a one-point code, is Hermitian self-orthogonal for $r\le q^2+q-3$, and converts through the nonbinary stabilizer-code lemma into a $q$-ary stabilizer code with parameters $[[q^3,\,q^3+q^2-3q-2r,\,r+2q-q^2]]$. For $q=3$, $r=7$, this gives $[[27,13,4]]_3$; for $q=5$ it gives a family of $5$-ary codes. The decoder-side discovery is the RL-on-Greedy algorithm: a standard greedy syndrome decoder first reduces the syndrome, and a trained deep Q-network then cleans up the residual syndrome, with simulations showing near-optimal correction on the $[[27,13,4]]_3$ code.
Load-bearing premise
Everything hinges on Lemma 3.1: the dimension of the code is taken from a count of monomials $x^i y^j$ with $i q + j(q-1) \le r$, as if the divisor were $rP_\infty$ rather than $r(q^2-q+1)P_\infty$, and the argument also assumes an auxiliary rational function $t$ exists with divisor $G - r(q^2-q+1)P_\infty$; if either is wrong, the stated dimension, distance, and quantum code parameters collapse.
Editorial extensions
If this is right
- If the construction is right, the $q=3$ case gives three qutrit codes: $[[27,13,4]]_3$, $[[27,11,5]]_3$, and $[[27,9,6]]_3$ for $r=7,8,9$.
- For $q=5$, the same theorem produces 5-ary codes from $[[125,99,3]]_5$ up to $[[125,91,7]]_5$.
- Every code in this family with $2r\le q^3+q^2-3q$ is Hermitian self-orthogonal, so the nonbinary stabilizer-code lemma applies uniformly to turn the whole family into quantum stabilizer codes.
- The RL-on-Greedy decoder is generic: it only needs the parity-check matrix, so it can be trained for any $\mathbb{F}_q$ stabilizer code, including nonbinary codes.
- On the $[[27,13,4]]_3$ code, the learned decoder corrects essentially every weight-$\le 2$ error pattern that is correctable in principle, so its logical failure rate is close to the code's true capability.
Reading between the lines
- If the parameters survive a direct check, $[[27,13,4]]_3$ has a high encoding rate (13 logical qutrits in 27 physical qutrits) for distance 4; a fair judgment of that rate needs a systematic table of known qutrit codes, which the paper does not include.
- The reported near-optimal performance is inferred from correcting weight-$\le 2$ patterns; a direct count of which weight-2 patterns still fail would quantify the gap to an exact maximum-likelihood decoder.
- The decoder is trained per code and noise model, so the 8%-to-0.5% drop should not be extrapolated to other codes or noise channels without retraining; testing on $[[27,11,5]]_3$ and $[[27,9,6]]_3$ would show whether the advantage persists as distance increases.
- The RL stage's one-or-two-step corrections suggest the residual syndromes after greedy are highly structured; examining their distribution could suggest cheaper deterministic rules that capture the same benefit without training.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a construction of classical Goppa codes and quantum stabilizer codes from plane curves defined by separated polynomials, focusing on curves of the form y^q + y = x^m with |m-q|=1. It claims a ternary code of length 27, dimension 13, distance 4 from the Hermitian curve y^3 + y = x^4, yielding a [[27,13,4]]_3 quantum code. The authors also introduce an RL-on-Greedy decoder that applies a greedy syndrome decoder followed by a deep Q-network, and report a reduction in logical failure rate from roughly 8% to 0.5% at p=0.01 on this code. The paper argues that the decoder approaches optimal performance for the claimed code.
Significance. If the code parameters were valid, the [[27,13,4]]_3 code would be a useful addition to qutrit stabilizer codes, and the RL-on-Greedy decoder would be a practical and generic enhancement for nonbinary decoding. The public availability of the implementation code is a strength for reproducibility. However, the central mathematical construction contains several load-bearing errors that invalidate the claimed code parameters, and the decoder's near-optimality claim is not benchmarked against any independent optimal decoder. As a result, the significance as stated is not realized by the manuscript in its current form.
major comments (5)
- [Section 3.1, Lemma 3.1 and Proposition 3.3] Lemma 3.1 claims a basis for L(G) with G = r(q^2-q+1)P_∞, but the monomial counting condition iq+j(q-1) ≤ r is the condition for L(rP_∞), not for L(r(q^2-q+1)P_∞); the divisor degree has been dropped by a factor of q^2-q+1. Independently, the pole orders (x)_∞ = qP_∞ and (y)_∞ = (q-1)P_∞ correspond to the curve y^q + y = x^{q-1}, not to the Hermitian curve y^q + y = x^{q+1} used in the abstract and in Section 5.4. For q=3, the paper's general condition q-m=1 gives m=2, while the example uses m=4. These two issues invalidate the dimension count in Proposition 3.3(3) and the parameter formulas in Theorem 4.2 for the claimed Hermitian-based code.
- [Section 3, definition of G and deg(G)] The divisor G is defined as G = sum_{P in X(F_q)} rP, and the paper claims deg(G) = r(q^2-q+1). This requires |X(F_q)| = q^2-q+1, but no evidence is given for this count. For q=3, the Hermitian curve y^3+y=x^4 has at most four F_3-rational points (three affine plus possibly one at infinity), not seven, so the claimed degree 7r is false on that curve. Since deg(G) directly determines the designed distance d* = n - deg(G) and the Riemann-Roch dimension k = deg(G)-g+1, the dimension and distance calculations in Section 3 and Example 4.3 are unsupported.
- [Section 3, Proposition 3.4 and Lemma 3.2] Proposition 3.4 asserts that G - (q^2-q+1)P_∞ is the divisor of a rational function t, which would make C(D,G) monomially equivalent to a one-point code, and Lemma 3.2 then derives the dual code formula. No such rational function is exhibited, and the existence of a principal divisor supported on the finite point set X(F_q) with the specified degree is not a general fact; for q=3 it would require a degree-7 principal divisor supported on the claimed seven points, which cannot exist because X(F_3) does not have seven points on either candidate curve. The monomial equivalence and the dual-distance formula are therefore not justified.
- [Section 5.4, decoder near-optimality claim] The claim that RL-on-Greedy 'approaches the performance of an optimal decoder' is not supported by the presented evidence. The paper only compares against a pure greedy decoder; it does not simulate a maximum-likelihood decoder, compute a quantum Hamming bound or other optimality bound, or report statistical uncertainty (error bars, number of trials, confidence intervals) for the failure rates. The agent is trained and evaluated on the same code and noise model, so the reported improvement is self-referential and does not establish near-optimal performance.
- [Section 5.4, dependence on unsupported code] The experimental section evaluates the decoder on a [[27,13,4]]_3 code whose existence depends on the classical code C_r from Theorem 4.2. As argued above, the dimension and distance calculations for C_r are invalid due to the incorrect pole orders, divisor degree, and unproved monomial equivalence. The simulation therefore does not demonstrate the decoder's value on a code that the paper has actually constructed; the experimental results are uninterpretable as a validation of the proposed construction.
minor comments (5)
- [Section 5.3] The text contains a dangling reference 'Eq., ??' after 'state transition'; this should be fixed to a proper equation number or removed.
- [Acknowledgments] The acknowledgment refers to 'the first author' and to support from TWAS/CNPq, but the paper lists only one author; this should be clarified.
- [Introduction and References] References [5,6,7] concern power-systems optimization and are not connected to the coding-theoretic content of the paper; they appear out of place in the introduction.
- [Example 4.4] For q=5, r=21 the paper correctly computes [[125,93,6]]_5, but then states that '[[125, 93, 12]]5 appears in tables of best-known codes [32]', which is inconsistent with the just-derived distance value of 6; the quoted table entry or the distance value needs correction.
- [Section 2.2 and Section 3] The symbol G is used both for the point set X(F_q) and for the divisor sum over that set; this notation is confusing and should be clarified, e.g., by using different symbols for the set and the divisor.
Circularity Check
No circular derivation: the claimed quantum-code parameters rest on standard AG-code machinery, and the RL decoder result is an empirical evaluation rather than a prediction forced by construction.
full rationale
The derivation chain is not circular. The code construction applies standard algebraic-geometry code definitions and a standard nonbinary stabilizer-code conversion (Lemma 4.1, attributed to Ashikhmin–Knill). The dimension and self-orthogonality claims are meant to follow from Riemann–Roch and standard one-point-code formulas, with proofs citing external references ([28,29]) rather than the authors' own results. The self-references that appear are background citations to the authors' prior separated-polynomial papers and are not load-bearing for the new theorem. No equation is equivalent to its input by definition. The paper's serious defects are mathematical correctness gaps, not circularity: the text fixes q−m=1 while the abstract's Hermitian example y^3+y=x^4 has m=q+1; Lemma 3.1 counts monomials against iq+j(q−1)≤r while claiming to describe L(r(q^2−q+1)P∞); and the asserted degree deg(G)=r(q^2−q+1) is unsupported and inconsistent with the actual number of F_3-points on the stated curve. Similarly, the RL-on-Greedy 'near-optimal performance' claim is not a derived prediction: the agent is trained and evaluated on the same code and noise model, so the simulation is self-referential as validation, but no fitted parameter is renamed as a predicted quantity in the mathematical chain. Therefore no circular step is exhibited, and the appropriate finding is no significant circularity.
Assumptions & free parameters
free parameters (2)
- Integer divisor coefficient r =
7, 8, 9 for q=3; 18 to 22 for q=5
- RL training hyperparameters =
Not stated
assumptions (4)
- ad hoc to paper The Weierstrass semigroup at P_infty for the curve y^q + y = x^m with |m-q|=1 is generated by q and q-1, so L(rP_infty) has dimension counted by #{i q + j(q-1) <= r}.
- ad hoc to paper There exists a rational function t on X with divisor G - (q^2-q+1)P_infty, so C(D,G) is monomially equivalent to a one-point code.
- ad hoc to paper The dual minimum distance of C_r satisfies d_perp >= r + 2q - q^2 in the stated r-range.
- domain assumption The curve has q^3 affine F_{q^2}-rational points and the set G has q^2-q+1 points.
Cite this review
Pith. "Pith review of Reinforcement Learning Enhanced Greedy Decoding for Quantum Stabilizer Codes over $\mathbb{F}_q$." pith.science (2026). https://pith.science/paper/LBBPWZI4
@misc{pith2026250603397,
author = {Pith},
title = {Pith review of: Reinforcement Learning Enhanced Greedy Decoding for Quantum Stabilizer Codes over $\mathbbF_q$},
year = {2026},
howpublished = {\url{https://pith.science/paper/LBBPWZI4}},
note = {Machine review of arXiv:2506.03397}
}
abstract
We construct new classical Goppa codes and corresponding quantum stabilizer codes from plane curves defined by separated polynomials. In particular, over $\mathbb{F}_3$ with the Hermitian curve $y^3 + y = x^4$, we obtain a ternary code of length 27, dimension 13, distance 4, which yields a [[27, 13, 4]]$_3$ quantum code. To decode, we introduce an RL-on-Greedy algorithm: first apply a standard greedy syndrome decoder, then use a trained Deep Q-Network to correct any residual syndrome. Simulation under a depolarizing noise model shows that RL-on-Greedy dramatically reduces logical failure compared to greedy alone. Our work thus broadens the class of Goppa- and quantum-stabilizer codes from separated-polynomial curves and delivers a learned decoder with near-optimal performance.
Figures
Reference graph
Works this paper leans on
-
[1]
V. D. Goppa, “Algebraic-Geometric Codes,” Math. USSR-Izv., vol. 21, no. 1, pp. 75–93, 1983
work page 1983
-
[2]
How to Construct Curves over Finite Fields with Many Points,
G. van der Geer and M. van der Vlugt, “How to Construct Curves over Finite Fields with Many Points,” Arithmetic Geometry (Cortona 1994), Cambridge Univ. Press , pp. 169–189, 1997
work page 1994
-
[3]
R. Fuhrmann, A. Garcia, and F. Torres, “On Maximal Curves,” Journal of Number Theory , vol. 67, no. 1, pp. 29–51, 1997
work page 1997
-
[4]
Improved Two-Point Codes on Hermitian Curves,
I. Duursma and R. Kirov, “Improved Two-Point Codes on Hermitian Curves,” IEEE Trans. Inf. Theory, vol. 57, no. 7, pp. 4469–4476, 2011
work page 2011
-
[5]
H. Davoudi, F. Wang, D. Shi, A. Xavier, F. Qiu, and Y. Chen, Market Pricing and Settle- ments Analysis Considering Capacity Sharing and Reserve Substitutions of Operating Reserve Products. 2023 North American Power Symposium (NAPS) (pp. 1-6). 2023
work page 2023
-
[6]
H. Davoudi, F. Wang, D. Shi, A. Xavier, and F. Qiu, Market Implications of Alternative Operating Reserve Modeling in Wholesale Electricity Markets. IEEE Transactions on Energy Markets, Policy and Regulation. 2024
work page 2024
-
[7]
H. Davoudi, and F. Wang, Umbrella Uncertainty Set Identification to Enhance Reserve Deliv- erability. Authorea Preprints. 2024
work page 2024
-
[8]
Toward the Determination of the Minimum Distance of Two-Point Codes on a Hermitian Curve,
M. Homma and S. J. Kim, “Toward the Determination of the Minimum Distance of Two-Point Codes on a Hermitian Curve,” Des. Codes Cryptogr. , vol. 37, pp. 111–132, 2005
work page 2005
Show all 35 references
-
[9]
The Complete Determination of the Minimum Distance of Two- Point Codes on a Hermitian Curve,
M. Homma and S. J. Kim, “The Complete Determination of the Minimum Distance of Two- Point Codes on a Hermitian Curve,” Des. Codes Cryptogr. , vol. 40, pp. 5–24, 2006
2006
-
[10]
The Two-Point Codes on a Hermitian Curve with the Designed Minimum Distance,
M. Homma and S. J. Kim, “The Two-Point Codes on a Hermitian Curve with the Designed Minimum Distance,” Des. Codes Cryptogr. , vol. 38, pp. 55–81, 2006
2006
-
[11]
A Note on Hermitian Codes over GF (q2),
H. Stichtenoth, “A Note on Hermitian Codes over GF (q2),” IEEE Trans. Inf. Theory, vol. 34, no. 5, pp. 1345–1348, 1988. 10
1988
-
[12]
Remarks on Codes from Hermitian Curves,
H. J. Tiersma, “Remarks on Codes from Hermitian Curves,” IEEE Trans. Inf. Theory, vol. 33, pp. 605–609, 1987
1987
-
[13]
On the True Minimum Distance of Hermitian Codes,
K. Yang and P. V. Kumar, “On the True Minimum Distance of Hermitian Codes,” in Coding Theory and Algebraic Geometry (Luminy, 1991) , vol. 1518 of Lecture Notes in Math., pp. 99– 107, Berlin: Springer, 1992
1991
-
[14]
Application of Classical Hermitian Self- Orthogonal MDS Codes to Quantum MDS Codes,
L. F. Jin, S. Ling, J. Q. Luo, and C. P. Xing, “Application of Classical Hermitian Self- Orthogonal MDS Codes to Quantum MDS Codes,” IEEE Trans. Inf. Theory , vol. 56, no. 9, pp. 4735–4740, 2010
2010
-
[15]
Euclidean and Hermitian Self-Orthogonal Algebraic Geometry Codes and Their Application to Quantum Codes,
L. F. Jin and C. P. Xing, “Euclidean and Hermitian Self-Orthogonal Algebraic Geometry Codes and Their Application to Quantum Codes,” IEEE Trans. Inf. Theory , vol. 58, no. 8, pp. 5484–5489, 2012
2012
-
[16]
Kim and G
J. Kim and G. Matthews, Quantum Error Correcting Codes from Algebraic Curves, Singapore: World Scientific, 2008
2008
-
[17]
Quantum Codes from Hyperelliptic Curve,
V. Nourozi and M. Afshar, “Quantum Codes from Hyperelliptic Curve,” Southeast Asian Bulletin of Mathematics , vol. 43, no. 3, pp. 395–400, 2019
2019
-
[18]
The rank of the Cartier operator on Picard curves,
V. Nourozi and F. Rahmati, “The rank of the Cartier operator on Picard curves,” arXiv preprint arXiv:2306.07823, 2023
2023 arXiv
-
[19]
The rank of the Cartier operator on certain Fq2-maximal function fields,
V. Nourozi and F. Rahmati, “The rank of the Cartier operator on certain Fq2-maximal function fields,” Missouri Journal of Mathematical Sciences , vol. 34, no. 2, pp. 184–190, 2022
2022
-
[20]
The a-number of maximal curves of third largest genus,
V. Nourozi and S. Tafazolian, “The a-number of maximal curves of third largest genus,” AUT Journal of Mathematics and Computing , vol. 3, no. 1, pp. 11–16, 2022
2022
-
[21]
The a-Number of Certain Hyperelliptic Curves,
V. Nourozi, F. Rahmati, and S. Tafazolian, “The a-Number of Certain Hyperelliptic Curves,” Iranian Journal of Science and Technology, Transactions A: Science , vol. 46, no. 4, pp. 1235– 1239, 2022
2022
-
[22]
Goppa Codes: Key to High Efficiency and Reliability in Communications,
B. Mosallaei, F. Ghanbari, S. Farivar, and V. Nourozi, “Goppa Codes: Key to High Efficiency and Reliability in Communications,” arXiv preprint arXiv:2404.08132, 2024
2024 arXiv
-
[23]
The a-number of yn = xm + x over finite fields,
B. Mosallaei, S. Farivar, F. Ghanbari, and V. Nourozi, “The a-number of yn = xm + x over finite fields,” arXiv preprint arXiv:2404.08149, 2024
2024 arXiv
-
[24]
Goppa Code and Quantum Stabilizer Codes from Plane Curves Given by Separated Polynomials,
V. Nourozi and F. Ghanbari, “Goppa Code and Quantum Stabilizer Codes from Plane Curves Given by Separated Polynomials,” arXiv preprint arXiv:2306.07833, 2023
2023 arXiv
-
[25]
The a-number of Jacobians of certain maximal curves,
V. Nourozi, S. Tafazolian, and F. Rahmati, “The a-number of Jacobians of certain maximal curves,” Transactions on Combinatorics, vol. 10, no. 2, pp. 121–128, 2021
2021
-
[26]
Application of the Cartier operator in coding theory,
V. Nourozi, “Application of the Cartier operator in coding theory,” Finite Fields and Their Applications, vol. 96, 102419, 2024
2024
-
[27]
V. Nourozi, The rank Cartier operator and linear systems on curves = Classifica¸ c˜ ao do op- erador Cartier e sistemas lineares na curva , Doctoral dissertation, University of Campinas (UNICAMP), 2021. 11
2021
-
[28]
On Goppa Codes and Weierstrass Gaps at Several Points,
C. Carvalho and F. Torres, “On Goppa Codes and Weierstrass Gaps at Several Points,” Des. Codes Cryptogr., vol. 35, no. 2, pp. 211–225, 2005
2005
-
[29]
Stichtenoth, Algebraic Function Fields and Codes , Springer, 2nd ed., 2009
H. Stichtenoth, Algebraic Function Fields and Codes , Springer, 2nd ed., 2009
2009
-
[30]
Some Ree and Suzuki Curves Are Not Galois Covered by the Hermitian Curve,
M. Montanucci and G. Zini, “Some Ree and Suzuki Curves Are Not Galois Covered by the Hermitian Curve,” Finite Fields and Their Applications , vol. 48, pp. 175–195, 2017
2017
-
[31]
Nonbinary Quantum Stabilizer Codes,
A. Ashikhmin and E. Knill, “Nonbinary Quantum Stabilizer Codes,” IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 3065–3072, 2001
2001
-
[32]
Some Good Quantum Twisted Codes,
J. Bierbrauer, “Some Good Quantum Twisted Codes,” (2013), http://www.mathi. uni-heidelberg.de/~yves/Matritzen/QTBCH/QTBCHIndex.html
2013
-
[33]
Ketkar, A
A. Ketkar, A. Klappenecker, S. Kumar and P.K. Sarvepalli, Nonbinary stabilizer codes over finite fields. IEEE transactions on information theory, 52(11), pp.4892-4914, 2006
2006
-
[34]
Fitzek, M
D. Fitzek, M. Eliasson, A.F. Kockum, and M. Granath, Deep Q-learning decoder for depolar- izing noise on the toric code. Physical Review Research, 2(2), p.023230, 2020
2020
-
[35]
Sweke, M.S
R. Sweke, M.S. Kesselring, E.P. van Nieuwenburg, and J. Eisert, Reinforcement learning de- coders for fault-tolerant quantum computation. Machine Learning: Science and Technology, 2(2), p.025005, 2020. 12
2020
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.