REVIEW 3 major objections 8 minor 26 references
Quantum Software Engineering in Practice: FPGA and AI Integration for Quantum Certification
T0 review · 3 major / 8 minor · reviewed 2026-07-09 · glm-5.2
Pith's one-line read FPGA + LLM hybrid reaches 99.94% of CHSH quantum limit
desk verdict A modular QSE framework for CHSH certification that ships working code but tests its LLM optimizer only in the trivial regime where it isn't needed. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
QAccCert (Quantum Accelerated Certification Framework), CHSH inequality, FPGA-accelerated correlation computation, LLM-guided angle optimization (DistilGPT2, Mistral-7B)
What would settle it
Run the QAccCert framework on a real NISQ device with noise. If the LLM-guided optimization does not achieve CHSH violations closer to the device-specific experimental optimum than a simple local search or random search, the claim that LLMs provide adaptive value for imperfect hardware would be undermined.
Extended reading notes
Core claim
The paper's central discovery is that an LLM can serve as a memory-driven optimizer for quantum measurement parameters, using the history of prior iterations to guide the search toward high-quality solutions. In the experiments, the DistilGPT2 model achieved 99.94% of the theoretical CHSH maximum, outperforming random search (97.3%) and a local perturbation fallback (97.9%) in solution quality. The paper also demonstrates that FPGA parallel computation of quantum correlations provides a constant-time hardware advantage that scales with system size, projecting a 9.4x speedup over CPU for the CHSH protocol and over 2,400x for systems with 1024 correlations.
Load-bearing premise
The paper assumes that using an LLM to suggest measurement angles provides a meaningful advantage for quantum certification, but its own results show a simple local perturbation heuristic achieves 97.9% of the maximum in fewer iterations (35 vs 41), making the LLM's benefit marginal in precision and worse in speed for this specific parameter space.
Editorial extensions
If this is right
- If the framework transfers to noisy hardware, the LLM's ability to learn device-specific imperfections could reduce the number of costly quantum measurements needed for certification on real NISQ devices.
- The modular architecture means the LLM or FPGA can be swapped independently, allowing the framework to adapt as quantum hardware and AI models evolve without full system redesigns.
- Extending the approach to multipartite systems like GHZ states would test whether the LLM-guided optimization scales to higher-dimensional parameter spaces where brute-force search is infeasible.
- Projected FPGA speedups suggest that for large-scale quantum benchmarking involving thousands of correlations, dedicated hardware could become a bottleneck-removing necessity rather than an optional accelerator.
Reading between the lines
- The paper's own data shows that a simple local perturbation heuristic converges in 35 iterations versus the LLM's 41, reaching 97.9% of the maximum. This suggests the LLM's advantage is in precision of the final result, not in convergence speed, and it remains unclear whether the marginal precision gain (99.94% vs 97.9%) justifies the computational overhead of running a language model.
- Because all experiments use an ideal simulator without a noise model, the claim that LLMs can adapt to hardware imperfections is untested. The framework's value on real NISQ devices depends on whether the LLM can distinguish noise-induced patterns from signal in the iteration history, which is a different and harder problem than exploring a smooth ideal parameter space.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents QAccCert, a hybrid framework for quantum entanglement certification via CHSH inequality violation, integrating FPGA-based correlation computation with LLM-guided optimization of measurement angles. The framework is evaluated in ideal Qiskit AerSimulator simulations (no noise model), comparing random search, local perturbation fallback, and two LLMs (DistilGPT2, Mistral-7B) for parameter optimization. The authors report that DistilGPT2 achieves S=2.8267 (99.94% of the theoretical maximum), outperforming the fallback heuristic (S=2.7686, 97.9%) and random search (S=2.7520, 97.3%). FPGA acceleration is characterized at three levels: current UART prototype (554.4 ms/iteration), projected USB 3.0 (0.00084 ms/iteration), and PC-only baseline (0.00197 ms/correlation). The paper frames the work as a Quantum Software Engineering case study demonstrating modular architecture, hardware abstraction, and adaptive optimization.
Significance. The paper provides a concrete software architecture with modular separation of concerns (quantum execution, FPGA acceleration, AI optimization, orchestration), accompanied by working code (GitHub repository linked in Figure 1). The FPGA Verilog implementation and Icestudio-based design represent a reproducible hardware contribution. However, the significance of the central claim—that LLM-guided optimization provides a meaningful advantage for quantum certification—is substantially undermined by the experimental design. The experiments are conducted entirely in ideal simulation where the CHSH optimum is analytically known, which is precisely the regime where the paper's own justification (§IV.D.2) states LLMs are unnecessary. The reported advantage of the best LLM over local perturbation is marginal in precision (1.9 percentage points) and worse in convergence speed (41 vs. 35 iterations). The FPGA speedup is projected rather than measured: the 9.4x figure relies on a hypothetical USB 3.0 interface, while the actual prototype introduces 550 ms of intentional delays. The paper does not provide falsifiable predictions for the noisy regime where LLMs would theoretically be advantageous
major comments (3)
- §IV.D.2 and §V: The central justification for using LLMs (adaptation to hardware imperfections where theoretical optima fail) is never tested. All experiments use ideal AerSimulator without a noise model—exactly the regime where θ=[0, π/4, π/8, 3π/8] are analytically optimal. The paper's own data confirms this: the fallback local perturbation achieves 97.9% in 35 iterations, while the best LLM (DistilGPT2) achieves 99.94% in 41 iterations—a marginal precision gain at higher iteration cost. Meanwhile, Mistral-7B (the more capable model) performs worse at 95.1% in 46 iterations, which is inconsistent with the claim that LLM reasoning quality drives optimization. The paper thus demonstrates LLM performance only in a trivial regime and provides no evidence about the noisy regime where the paper's own argument says LLMs would be needed. This is load-bearing because the abstract and conclusion
- Table II: The claim that LLM optimization demonstrates 'more efficient parameter space exploration' is not supported by the data. DistilGPT2 requires 41 iterations vs. 35 for the fallback, while achieving only 2.1% higher S. The paper itself acknowledges this trade-off in §V.B.2 ('the LLM's advantage is qualitative, not quantitative'), but the abstract and conclusion still frame LLM optimization as 'efficient.' The inconsistency between the claimed efficiency and the reported iteration counts needs to be reconciled, or the claims should be scaled back to match what the data actually shows.
- Table I and §V.B.1: The 9.4x FPGA speedup is projected, not measured. The actual prototype achieves 554.4 ms/iteration (slower than the PC baseline of ~0.08 ms for 4 correlations), with 99.9% of the time consumed by intentional communication delays. The projected USB 3.0 performance (0.00084 ms/iteration) is a calculation based on interface bandwidth, not an empirical measurement. The paper should clearly distinguish between measured and projected performance throughout, and the abstract/conclusion should not present the 9.4x figure as an achieved result. The claim that FPGA acceleration 'significantly reduces classical post-processing times' (§II, contribution 2) is not demonstrated empirically.
minor comments (8)
- Abstract: The phrase 'achieving 99.94% of the theoretical limit' could mislead readers into thinking this was achieved on real hardware. The abstract should clarify that all results are from ideal simulation.
- §III.B, Eq. (1): The CHSH inequality is presented without defining the correlation function E(α,β) in terms of measurement probabilities. A brief definition would help readers unfamiliar with the protocol.
- Algorithm 1, line 13: The condition 'iter mod 2 = 0' for LLM queries is not motivated. Why every other iteration? This design choice should be explained or its sensitivity analyzed.
- Table II note: The efficiency percentages are computed as S/(2√2)×100, but 2√2≈2.828 is an approximation. Using 2.828427... would change the reported percentages slightly.
- §V.B.1: The phrase 'intentional delays' for the UART prototype is explained only in a note. This should be stated more prominently in the main text, as the 554.4 ms figure is otherwise misleading without these delays.
- Figure 3 caption references '41 iterations' but does not explain why this specific iteration count was chosen.
- References [14] and [15] are self-citations by the authors. This is acceptable but should be noted for transparency in the related work section.
- §VII.B: The future work on initializing with theoretical angles is promising but contradicts the current approach of starting from random angles. This tension should be acknowledged.
Simulated Author's Rebuttal
We thank the referee for a careful and substantive reading of our manuscript. The report correctly identifies that the central claims about LLM advantage and FPGA speedup are not fully supported by the current experimental evidence in the form they are presently stated. We agree with the referee on two of three major comments and will revise the manuscript accordingly. On the first comment, we partially agree: the referee is right that the ideal-simulation regime does not test the core motivation for using LLMs, and we will scale back claims accordingly. However, we also clarify that the paper's primary contribution is the QSE architecture itself, not a demonstration that LLMs outperform classical optimizers in the ideal regime.
read point-by-point responses
-
Referee: §IV.D.2 and §V: The central justification for using LLMs (adaptation to hardware imperfections where theoretical optima fail) is never tested. All experiments use ideal AerSimulator without a noise model—exactly the regime where θ=[0, π/4, π/8, 3π/8] are analytically optimal. The paper's own data confirms this: the fallback local perturbation achieves 97.9% in 35 iterations, while the best LLM (DistilGPT2) achieves 99.94% in 41 iterations—a marginal precision gain at higher iteration cost. Meanwhile, Mistral-7B (the more capable model) performs worse at 95.1% in 46 iterations, which is inconsistent with the claim that LLM reasoning quality drives optimization. The paper thus demonstrates LLM performance only in a trivial regime and provides no evidence about the noisy regime where the paper's own argument says LLMs would be needed. This is load-bearing because the abstract and conclusion
Authors: The referee is correct that the ideal-simulation regime does not test the central motivation for LLM-based optimization, and we will revise the abstract, §IV.D.2, and §V to make this limitation explicit. We will remove or qualify language suggesting that the current results demonstrate LLM advantage in the noisy regime. We will also add an honest discussion of the Mistral-7B underperformance, noting that model size does not guarantee better optimization in this task and that the result may reflect sensitivity to prompt design and temperature settings rather than reasoning capability per se. That said, we wish to clarify the paper's intended contribution. The manuscript's primary claim is architectural: QAccCert demonstrates that FPGAs, LLMs, and quantum backends can be integrated within a modular QSE framework with well-defined interfaces. The numerical results serve as a proof of concept that the integration is functional, not as evidence that LLMs outperform classical optimizers. We will make this framing explicit in the revision. We acknowledge that without noisy-regime experiments, we cannot substantiate the claim that LLMs provide meaningful advantage where theoretical optima fail. We will add this as a stated limitation and outline it as immediate future work rather than leaving it implicit. revision: partial
-
Referee: Table II: The claim that LLM optimization demonstrates 'more efficient parameter space exploration' is not supported by the data. DistilGPT2 requires 41 iterations vs. 35 for the fallback, while achieving only 2.1% higher S. The paper itself acknowledges this trade-off in §V.B.2 ('the LLM's advantage is qualitative, not quantitative'), but the abstract and conclusion still frame LLM optimization as 'efficient.' The inconsistency between the claimed efficiency and the reported iteration counts needs to be reconciled, or the claims should be scaled back to match what the data actually shows.
Authors: The referee is correct. The data shows that DistilGPT2 achieves higher solution quality (99.94% vs. 97.9%) but requires more iterations (41 vs. 35). The word 'efficient' in the abstract and conclusion is misleading because it conflates solution quality with convergence speed. We will revise the abstract to replace 'more efficient parameter space exploration' with language that accurately describes the result: the LLM achieves higher solution quality (higher S value) at the cost of additional iterations. The conclusion will be revised similarly. We will also ensure that §V.B.2's acknowledgment of the qualitative-not-quantitative advantage is consistent with the claims made in the abstract and conclusion. revision: yes
-
Referee: Table I and §V.B.1: The 9.4x FPGA speedup is projected, not measured. The actual prototype achieves 554.4 ms/iteration (slower than the PC baseline of ~0.08 ms for 4 correlations), with 99.9% of the time consumed by intentional communication delays. The projected USB 3.0 performance (0.00084 ms/iteration) is a calculation based on interface bandwidth, not an empirical measurement. The paper should clearly distinguish between measured and projected performance throughout, and the abstract/conclusion should not present the 9.4x figure as an achieved result. The claim that FPGA acceleration 'significantly reduces classical post-processing times' (§II, contribution 2) is not demonstrated empirically.
Authors: The referee is correct. The 9.4x speedup is a projection based on USB 3.0 bandwidth calculations, not an empirical measurement. The actual prototype with UART is slower than the PC baseline due to intentional communication delays. We will revise the manuscript as follows: (1) The abstract and conclusion will not present the 9.4x figure as an achieved result. (2) Throughout the paper, we will clearly label projected performance as projected and measured performance as measured. (3) Contribution 2 in §II will be reworded from 'FPGA acceleration significantly reduces classical post-processing times' to language that accurately reflects what was demonstrated: the FPGA prototype implements correlation computation in hardware, and projected performance under a high-speed interface suggests potential speedup, but this has not been empirically validated. (4) Table I and Table III will be annotated to make the projected vs. measured distinction unambiguous. revision: yes
Circularity Check
No significant circularity: the central claim is tested against an external benchmark (CHSH), and self-citations are contextual, not load-bearing.
full rationale
The paper's central claim — that LLM-guided optimization achieves 99.94% of the CHSH theoretical maximum — is evaluated against an external, well-known benchmark (the CHSH inequality, ref [5], external). The optimization result is not forced by construction: the algorithm initializes at the known theoretical angles, but the outcome depends on the LLM's suggestions, and indeed different LLMs produce different results (DistilGPT2 at 99.94%, Mistral-7B at 95.1%), showing the result is not tautologically determined by the setup. Self-citations [14] and [15] (by Lammers and Fernández) appear in related work for quantum resource management context but do not serve as load-bearing premises for the CHSH optimization claim — the architecture and experiments are described self-containedly. The paper's real weaknesses (testing only in noiseless simulation where the optimum is analytically known, marginal LLM advantage over simple local perturbation) are correctness and experimental-validity concerns, not circularity. No step in the derivation chain reduces to its own inputs by definition or by self-citation.
Assumptions & free parameters
free parameters (3)
- LLM temperature =
0.5
- Algorithm iteration count (N_max) =
Not specified, but results show 35-46 iterations
- FPGA communication delays =
20ms initial, 4x10ms pauses, 500ms response
assumptions (3)
- standard math CHSH inequality violation is a valid metric for entanglement certification.
- domain assumption LLMs can identify patterns in optimization history to suggest promising parameters.
- ad hoc to paper Projected USB 3.0 performance accurately reflects future FPGA capability.
invented entities (1)
-
QAccCert Framework
independent evidence
Cite this review
Pith. "Pith review of Quantum Software Engineering in Practice: FPGA and AI Integration for Quantum Certification." pith.science (2026). https://pith.science/paper/DRQVTRNG
@misc{pith2026260707597,
author = {Pith},
title = {Pith review of: Quantum Software Engineering in Practice: FPGA and AI Integration for Quantum Certification},
year = {2026},
howpublished = {\url{https://pith.science/paper/DRQVTRNG}},
note = {Machine review of arXiv:2607.07597}
}
abstract
The emergence of Quantum Software Engineering (QSE) responds to the need for systematic, disciplined, and quantifiable approaches to the development, operation, and maintenance of quantum software. Within this context, quantum computer certification represents a significant challenge: verifying that quantum devices produce valid entangled states despite hardware imperfections, noise, and decoherence. This paper presents QAccCert, a hybrid certification framework developed following QSE principles, demonstrating how heterogeneous technologies like FPGAs and Artificial Intelligence can be integrated for quantum processing. The framework implements entanglement certification through CHSH inequality violation in ideal quantum simulations using Qiskit AerSimulator. Through LLM-guided optimization, the system achieves 99.94% of the theoretical maximum of $2\sqrt{2}$, evidencing more efficient parameter space exploration than random search. These simulated results illustrate how QSE methodologies, combined with strategic technology interconnection, can be applied for practical and scalable quantum certification on real NISQ hardware in future work. This study provides a concrete case study of systematic quantum software development.
Figures
Reference graph
Works this paper leans on
-
[1]
Group-invariant estimation of symmetric states generated by noisy quantum computers,
F. H. Holik and et al., “Group-invariant estimation of symmetric states generated by noisy quantum computers,”Quantum Information Processing, vol. 24, 2024. [Online]. Available: https://api.semanticscholar.org/CorpusID:271903807
work page 2024
-
[2]
MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing,
N. Quetschlich and et al., “MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing,”Quantum, vol. 7, p. 1062, Jul. 2023. [Online]. Available: https://doi.org/10.22331/ q-2023-07-20-1062
work page 2023
-
[3]
Benchq: Quantum benchmarking framework,
Zapata Computing, “Benchq: Quantum benchmarking framework,” https://github.com/zapatacomputing/benchq, 2024, ´Ultimo acceso: 2026
work page 2024
-
[4]
Rigetti Computing, “Rigetti resource estimation,” https://github.com/ rigetti/rigetti-resource-estimation, 2024, ´Ultimo acceso: 2026
work page 2024
-
[5]
Distribution of nonlocality on quantum random circuits,
A. C. Granda Arango and et al., “Distribution of nonlocality on quantum random circuits,”Phys. Rev. A, vol. 112, no. 6, p. 062427, Dec
-
[7]
A. K. Mandal and et al., “Quantum software engineering and potential of quantum computing in software engineering research: A review,” Automated Software Engineering, vol. 32, no. 1, p. 27, Mar. 2025
work page 2025
-
[8]
Quantum software engineering: Roadmap and challenges ahead,
J. M. Murillo and et al., “Quantum software engineering: Roadmap and challenges ahead,”ACM Trans. Softw. Eng. Methodol., vol. 34, no. 5, May 2025. [Online]. Available: https://doi.org/10.1145/3712002
-
[9]
Proyecto k ´efir: Kit educativo con fpga, inclusivo y reciclable,
S. Tropea and Proyecto FPGA Libre, “Proyecto k ´efir: Kit educativo con fpga, inclusivo y reciclable,” https://fpgalibre.sourceforge.net/Kefir/ index.html, 2017, hardware abierto para FPGA educativas
work page 2017
Show all 26 references
-
[10]
icestu- dio: Visual editor for open fpga boards,
C. Venegas Arrab ´e, J. Arroyo, and FPGAwars community, “icestu- dio: Visual editor for open fpga boards,” https://github.com/FPGAwars/ icestudio, 2025
2025
-
[11]
Bridging paradigms: Designing for hpc- quantum convergence,
A. Shehata and et al., “Bridging paradigms: Designing for hpc- quantum convergence,”Future Generation Computer Systems, vol. 174, p. 107980, 2026. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0167739X25002754
2026
-
[12]
Integrating quantum computing resources into scientific hpc ecosystems,
T. Beck and et al., “Integrating quantum computing resources into scientific hpc ecosystems,”Future Generation Computer Systems, vol. 161, pp. 11–25, 2024. [Online]. Available: https://www.sciencedirect. com/science/article/pii/S0167739X24003583
2024
-
[13]
A conceptual architecture for a quantum- hpc middleware,
N. Saurabh and et al., “A conceptual architecture for a quantum- hpc middleware,” in2023 IEEE International Conference on Quantum Software (QSW), 2023, pp. 116–127
2023
-
[14]
An overview of quantum software engi- neering in Latin America,
Aparicio-Morales and et al., “An overview of quantum software engi- neering in Latin America,”Quantum Information Processing, vol. 23, no. 11, p. 380, Nov. 2024
2024
-
[15]
Quantum resource management in the nisq era: Implications and perspectives from software engineering,
M. G. Lammers, F. H. Holik, and A. Fern ´andez, “Quantum resource management in the nisq era: Implications and perspectives from software engineering,” 2025. [Online]. Available: https://arxiv.org/abs/2508.05697
2025 arXiv
-
[16]
Quantum resource management in the nisq era: Challenges, vision, and a runtime framework,
——, “Quantum resource management in the nisq era: Challenges, vision, and a runtime framework,” 2025. [Online]. Available: https://arxiv.org/abs/2508.19276
2025 arXiv
-
[17]
Fire opal: Automated performance optimization for quan- tum algorithms,
Q-CTRL, “Fire opal: Automated performance optimization for quan- tum algorithms,” https://q-ctrl.com/fire-opal, 2025, plataforma comercial para supresi ´on de errores y abstracci ´on de hardware cu ´antico
2025
-
[18]
Fast simulation of stabilizer circuits using a graph-state representation,
S. Anders and et al., “Fast simulation of stabilizer circuits using a graph-state representation,”Phys. Rev. A, vol. 73, no. 2, p. 022334, Feb
-
[19]
Available: https://link.aps.org/doi/10.1103/PhysRevA
[Online]. Available: https://link.aps.org/doi/10.1103/PhysRevA. 73.022334
-
[20]
Stim: A fast stabilizer circuit simulator,
C. Gidney, “Stim: A fast stabilizer circuit simulator,” 2022. [Online]. Available: https://arxiv.org/abs/2209.07345
2022 arXiv
-
[21]
Mistral-7b-instruct-v0.2,
Mistral AI Team, A. Jiang, and et al., “Mistral-7b-instruct-v0.2,” https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2, 2023, modelo de lenguaje de 7B par ´ametros fine-tuned para instrucciones
2023
-
[22]
Distilgpt2,
V . Sanh and et al., “Distilgpt2,” https://huggingface.co/distilbert/ distilgpt2, 2019, versi ´on destilada de GPT-2 (82M par ´ametros)
2019
-
[23]
Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter,
——, “Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter,” 2020. [Online]. Available: https://arxiv.org/abs/1910.01108
2020 arXiv
-
[24]
A survey on knowledge distillation of large language models,
X. Xu and et al., “A survey on knowledge distillation of large language models,” 2024. [Online]. Available: https://arxiv.org/abs/2402.13116
2024 arXiv
-
[25]
Chsh violations using dynamic circuits,
J.-B. Waring, C. Pere, and S. Le Beux, “Chsh violations using dynamic circuits,” in2025 IEEE International Conference on Quantum Comput- ing and Engineering (QCE), vol. 01, 2025, pp. 2426–2432
2025
-
[26]
Trends in High Performance Computing and Quantum Computing,
A. Pousa and et al., “Trends in High Performance Computing and Quantum Computing,”Journal of Computer Science and Technology, vol. 24, no. 2, p. e11, Oct. 2024
2024
-
[27]
Desaf ´ıos en la integraci´on de QPUs a sistemas HPC cl´asicos,
A. Pousa and V . Sanz, “Desaf ´ıos en la integraci´on de QPUs a sistemas HPC cl´asicos,”Memoria Investigaciones en Ingenier ´ıa, no. 27, pp. 238– 247, Dec. 2024
2024
Reviewed July 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.