REVIEW 3 major objections 6 minor 2 cited by
SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows
T0 review · 3 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Splitting a hybrid job into single-quantum-block sub-jobs lets SLURM interleave workflows, cutting quantum-device idle time and combined wall time.
desk verdict A useful and plausible engineering recipe for splitting hybrid SLURM jobs, but the central saving is asserted, not measured; worth refereeing as a practice paper, not as a demonstrated result. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mechanism combines three standard tools. SLURM heterogeneous jobs (the hetjob directive with separate partitions, e.g. -p cpu and -p qpu) allocate classical and quantum service-node resources inside one job; MPI dynamic process management (Open_port, Publish_name, Accept, Connect, Disconnect) creates a client-server intercommunicator between the classical server and the quantum client, each in its own MPI_COMM_WORLD; and a scancel call from the server terminates the client job once the quantum block is done, releasing the device. Checkpoint and restart, for example with pickle in Python, carries classical state between sub-jobs, and a dependency flag (-d) to sbatch preserves order. The paper supplies pseudo-code and SLURM scripts showing how these pieces fit together, with the possibility of embedding them in an API.
What would settle it
Run two hybrid jobs that each need several quantum blocks on a SLURM cluster with a real or simulated quantum device, once as monolithic jobs scheduled sequentially and once split into single-block sub-jobs using MPI dynamic process management and scancel. Measure the quantum device's idle time and the combined wall time in both configurations; if the split version does not reduce device idle time or combined wall time, the scheduling opportunity described in the paper does not occur in practice.
Extended reading notes
Core claim
The central claim is that job splitting converts a monolithic hybrid workflow—one that occupies a quantum device for the entire duration of a classical allocation—into a sequence of independent sub-jobs, each with a single quantum block, that SLURM can schedule like ordinary jobs. The authors show how the quantum component can run as a client with its own MPI_COMM_WORLD, connect to a classical server through MPI Open_port/Accept/Connect, and be terminated by scancel as soon as the block finishes, so the device is released as soon as possible. With several split jobs in the queue, SLURM gains an opportunity to interleave their quantum blocks and fill what would otherwise be idle time, reducing the quantum device's overall idle time and the combined wall time of two jobs compared with a sequential schedule. Working code was run on a current-generation supercomputer as a proof of concept, although the paper reports no measurements of the gain.
Load-bearing premise
The load-bearing premise is that the overhead of splitting—checkpoint and restart, MPI connection setup and teardown, SLURM job startup and termination, and scancel propagation—is small relative to the duration of a quantum block, so the quantum time released early is not offset by delays in reacquiring the device.
Editorial extensions
If this is right
- A single quantum device can be shared by interleaving small quantum blocks from multiple hybrid jobs, so it no longer has to be reserved for the full wall time of each classical job.
- Users on existing supercomputers can improve quantum utilization without installing new software stacks; the required SLURM and MPI features are already standard.
- The scheduling benefit should grow with the number of sub-jobs and the number of co-scheduled workflows, because more blocks create more opportunities for SLURM to fill idle gaps.
- The split can be hidden inside an API, so application scientists keep a high-level workflow and do not manage the client-server mechanics by hand.
- Hybrid workflows that previously had to queue for contiguous quantum access can instead be co-scheduled, shortening the time users wait for their results.
Reading between the lines
- A direct benchmark extension would measure monolithic versus split execution across a range of quantum-block durations; the paper's claim implies there is a block-size threshold below which checkpoint/restart and MPI connect/disconnect overhead erase the scheduling gain.
- The same release-early pattern should transfer to other scarce accelerators (GPUs, FPGAs) and to any scheduler supporting heterogeneous jobs and job dependencies, not just SLURM/MPI.
- If the benefit scales with the number of interleavable blocks, the method offers a low-cost interim path for NISQ-era hybrid computing, complementing dedicated quantum software stacks until they mature.
- A testable prediction from the paper's argument is that combined wall time shrinks roughly in proportion to the number of released inter-block gaps, and that this reduction disappears when quantum blocks become as short as the sub-job overhead.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a scheduling method for hybrid classical-quantum workflows on SLURM-based HPC systems. A monolithic job that repeatedly accesses a quantum device is split into sub-jobs containing exactly one quantum block. The quantum device is released promptly after each block using MPI dynamic process management (intercommunicators) and a scancel call from the server component. The authors argue that this split gives the SLURM scheduler the opportunity to interleave sub-jobs from different users, reducing quantum-device idle time and total wall time. The manuscript provides an architecture description, pseudo-code for the server and client, and a SLURM heterogeneous job script. No quantitative evaluation is included; the conclusion states that collecting data to statistically quantify the advantage is future work.
Significance. If the claimed advantage is real, this is a practically useful contribution: it addresses a genuine inefficiency in hybrid classical-quantum execution using only standard SLURM and MPI features, and the pseudo-code gives implementers a concrete starting point. The architecture is coherent, the use of standard tools is appropriate, and the split-and-release idea is not circular: it does not depend on fitted parameters or on results from the authors' prior work [12]. However, the central quantitative claims are currently unsupported. The paper explicitly defers data collection to future work, and the assertion that working code was run on an HPE-Cray EX system is not accompanied by logs, scripts, or benchmarks. The contribution is therefore best described as a plausible and clearly presented engineering pattern, not a validated scheduling method.
major comments (3)
- [Section 2.3, Fig. 3, and Section 4] The central claims that splitting reduces the quantum device's idle time and that 'the combined wall time of two jobs is reduced compared to a sequential scheduling' are not supported by measurements. Section 4 states that data collection is future work, and no logs, benchmarks, or comparison runs appear in the paper. Since the claimed benefit depends on per-sub-job overheads (checkpoint/restart, MPI Open_port/Accept/Connect/Disconnect, SLURM job startup/teardown, and scancel propagation) being small relative to the duration of a quantum block, the authors should provide measurements from the claimed HPE-Cray EX runs or, at minimum, a parameterized overhead model showing under what conditions the split wins. Without that, Fig. 3 is an illustration of a possible schedule rather than evidence of improvement.
- [Section 2.3, Listings 5 and 7] The scancel-based release mechanism is not fully specified. Listing 7 submits the server and client as two components of a single SLURM heterogeneous job, and Listing 5 calls scancel from the server to 'terminate the client.' SLURM scancel normally operates on a whole job or job step, so it is unclear whether this command terminates only the client component or the entire heterogeneous job. If it terminates the entire job, the server's remaining classical work after scancel would not execute, breaking the proposed workflow. Please specify the exact job identifiers or steps targeted by scancel and provide log output demonstrating that only the client component is terminated.
- [Section 2.3, paragraph on optimized scheduling] The statement that splitting 'gives an opportunity to SLURM' to reduce idle time does not by itself establish that the combined wall time of two jobs is reduced. Interleaving requires that classical CPU resources for a second job are available while the first job is in its quantum block, and that the scheduler actually packs sub-jobs in the order shown in Fig. 3. If CPU nodes are scarce or the scheduler's policy does not backfill in that manner, the split schedule can be worse than the monolithic baseline. The paper should state these assumptions explicitly and either prove the wall-time reduction under them or clearly label it as a conditional expectation.
minor comments (6)
- [Abstract] There are two typos: 'in to' should be 'into' and 'bares the potential' should be 'bears the potential.'
- [Section 2.2] The phrase 'an quantum program' should be 'a quantum program.'
- [Listing 2] The comment 'instead ofirecv' is missing a space and should read 'instead of irecv'; also, 'revc' appears to be a typo for 'recv.'
- [Listing 4] The word 'ceckpoint' appears twice and should be 'checkpoint.'
- [Listing 7] The caption says 'SLURM Heterogeneous job script for listing 3,' but the script appears to implement the split workflow of Listing 4 rather than the monolithic loop of Listing 3; please clarify or correct the cross-reference.
- [Listings 5 and 6] The shutdown protocol is incomplete: Listing 5 calls shut_down_client_listener, but Listing 6's listener loop has no visible exit condition and no message that would terminate the while loop, so the described shutdown is not reproducible from the pseudo-code alone.
Circularity Check
No significant circularity; the main benefit is conditionally argued and explicitly deferred for measurement, not reduced from a fit or self-citation.
full rationale
The paper contains no fitted parameters, no equations, and no benchmark that would allow a derived quantity to equal its input by construction. Its central claim is that splitting a monolithic job into one-quantum-block sub-jobs and releasing the quantum partition via MPI dynamic process management and scancel gives SLURM "an opportunity" to interleave sub-jobs, reducing quantum-device idle time and combined wall time (Section 2.3, Fig. 3). This is a conditional engineering argument, not a derivation: it depends on the scheduler actually generating such a schedule and on per-sub-job overheads being small. Section 4 explicitly says "In a future work we want to collect data on a test system to statistically quantify the advantage of the proposed method," confirming that the quantitative benefit is an unverified hypothesis rather than a claimed derivation. The only self-citation is [12], referenced in Section 1 as "In this work we further develop the ideas presented in [12]." Since the novel split-and-release mechanism is fully specified by the paper's own listings and by standard SLURM/MPI features, this citation is not load-bearing for the paper's conclusion. Lack of empirical validation is a real limitation, but it is an evidentiary gap, not circularity.
Assumptions & free parameters
assumptions (4)
- domain assumption SLURM heterogeneous jobs and the -d dependency flag behave as shown in Listings 1 and 7, allowing the two heterogeneous components to start at different times and be scheduled independently.
- domain assumption MPI dynamic process management with Open_port, Publish_name, Accept, Connect, Disconnect, and scancel can start and tear down the quantum client per sub-job with negligible overhead.
- domain assumption Checkpointing the classical state, for example with pickle, between sub-jobs preserves all required state and costs less than the quantum-device idle time saved.
- domain assumption A dedicated service node can be represented as a schedulable SLURM partition named 'qpu' with immediate access to the quantum device whenever allocated.
Cite this review
Pith. "Pith review of SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows." pith.science (2026). https://pith.science/paper/MSEGKSL3
@misc{pith2026250603846,
author = {Pith},
title = {Pith review of: SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows},
year = {2026},
howpublished = {\url{https://pith.science/paper/MSEGKSL3}},
note = {Machine review of arXiv:2506.03846}
}
read the original abstract
A method for efficient scheduling of hybrid classical-quantum workflows is presented, based on standard tools available on common supercomputer systems. Moderate interventions by the user are required, such as splitting a monolithic workflow in to basic building blocks and ensuring the data flow. This bares the potential to significantly reduce idle time of the quantum resource as well as overall wall time of co-scheduled workflows. Relevant pseudo-code samples and scripts are provided to demonstrate the simplicity and working principles of the method.
Figures
Forward citations
Cited by 2 Pith papers
-
Examining QRMI as a Unified Interface for Quantum-HPC Integration
QRMI's acquire-execute-release interface can be adapted to PBS, LSF, Grid Engine, Kubernetes, and partly Flux, with three reusable integration patterns.
-
Introducing CQ: A C-like API for Quantum Accelerated HPC
CQ is an open-source C-like API and simulator backend for offloading quantum kernels from HPC codes, with sync/async executors and an experimental analogue-annealing extension.
Reference graph
Works this paper leans on
-
[12]
A hybrid classical-quantum hpc workload
Aniello Esposito, Jessica R Jones, Sebastien Cabaniols, and David Brayford. A hybrid classical-quantum hpc workload. In 2023 IEEE International Conference on Quantum Computing and Engineering (QCE) , volume 2, pages 117–121. IEEE, 2023
work page 2023
-
[1]
Quantum algorithms: an overview
Ashley Montanaro. Quantum algorithms: an overview. npj Quantum Information, 2(1):1–8, 2016
work page 2016
-
[2]
Grace Johnson, Oded Wertheim, Matthew Otten, Navid Anjum Aadit, Yuri Alexeev, Kirk M
Masoud Mohseni, Artur Scherer, K. Grace Johnson, Oded Wertheim, Matthew Otten, Navid Anjum Aadit, Yuri Alexeev, Kirk M. Bresniker, Kerem Y . Camsari, Barbara Chapman, Soumitra Chatterjee, Gebremedhin A. Dagnew, Aniello Esposito, Farah Fahim, Marco Fiorentino, Archit Gajjar, Abdullah Khalid, Xiangzhou Kong, Bohdan Kulchytskyy, Elica Kyoseva, Ruoyu Li, P. A...
work page 2025
-
[3]
James H. Davenport, Jessica R. Jones, and Matthew Thomason. A practical overview of quantum computing: Is exascale possible?, 2023
work page 2023
-
[4]
Matthew Kiser, Matthias Beuerle, and Fedor Simkovic IV . Contextual subspace auxiliary-field quantum monte carlo: Improved bias with reduced quantum resources, 2024
work page 2024
-
[5]
Quantum monte carlo on quantum computers. https://github.com/amazon-braket/ amazon-braket-examples/blob/feature/quantum-monte-carlo/examples/hybrid_quantum_ algorithms/Quantum_Monte_Carlo_Chemistry/Quantum_Monte_Carlo_Chemistry.ipynb
-
[6]
Hybrid classical-quantum simulation of maxcut using qaoa-in-qaoa
Aniello Esposito and Tamuz Danzig. Hybrid classical-quantum simulation of maxcut using qaoa-in-qaoa. In 2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) , pages 1088–1094. IEEE, 2024
work page 2024
-
[7]
Martin Schulz, Laura Schulz, Martin Ruefenacht, and Robert Wille. Towards the munich quantum software stack: Enabling efficient access and tool support for quantum computers. In 2023 IEEE International Conference on Quantum Computing and Engineering (QCE) , volume 2, pages 399–400. IEEE, 2023
work page 2023
Show all 20 references
-
[8]
Qdmi-quantum device management interface: Hardware-software interface for the munich quantum 7 SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows software stack
Robert Wille, Ludwig Schmid, Yannick Stade, Jorge Echavarria, Martin Schulz, Laura Schulz, and Lukas Burgholzer. Qdmi-quantum device management interface: Hardware-software interface for the munich quantum 7 SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows softw...
2024
-
[9]
https://slurm.schedmd.com/
Slurm workload manager. https://slurm.schedmd.com/
-
[10]
Slurm: Simple linux utility for resource management
Andy B Yoo, Morris A Jette, and Mark Grondona. Slurm: Simple linux utility for resource management. In Workshop on job scheduling strategies for parallel processing , pages 44–60. Springer, 2003
2003
-
[11]
MPI: A Message-Passing Interface Standard V ersion 4.0, Jun 2021
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard V ersion 4.0, Jun 2021
2021
-
[13]
Ibm’s qiskit tool chain: Working with and developing for real quantum computers
Robert Wille, Rod Van Meter, and Yehuda Naveh. Ibm’s qiskit tool chain: Working with and developing for real quantum computers. In 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE) , pages 1234–1240. IEEE, 2019
2019
-
[14]
Quantum computing with qiskit
Ali Javadi-Abhari, Matthew Treinish, Kevin Krsulich, Christopher J Wood, Jake Lishman, Julien Gacon, Simon Martiel, Paul D Nation, Lev S Bishop, Andrew W Cross, et al. Quantum computing with qiskit. arXiv preprint arXiv:2405.08810, 2024
2024 arXiv
-
[15]
https://qiskit.github.io/qiskit-addon-cutting/
Qiskit addon: circuit cutting. https://qiskit.github.io/qiskit-addon-cutting/
-
[16]
https://developer.nvidia.com/cuda-q#section-resources
Nvidia cuda-q. https://developer.nvidia.com/cuda-q#section-resources
-
[17]
Qrisp: A framework for compilable high-level programming of gate-based quantum computers
Raphael Seidel, Sebastian Bock, René Zander, Matic Petriˇc, Niklas Steinmann, Nikolay Tcholtchev, and Manfred Hauswirth. Qrisp: A framework for compilable high-level programming of gate-based quantum computers. arXiv preprint arXiv:2406.14792, 2024
2024 arXiv
-
[18]
Simulations of quantum circuits with approximate noise using qsim and cirq
Sergei V Isakov, Dvir Kafri, Orion Martin, Catherine V ollgraff Heidweiller, Wojciech Mruczkiewicz, Matthew P Harrigan, Nicholas C Rubin, Ross Thomson, Michael Broughton, Kevin Kissell, et al. Simulations of quantum circuits with approximate noise using qsim and cirq. arXiv pr...
2021 arXiv
-
[19]
Cirq: A python framework for creating, editing, and invoking quantum circuits
Andrew Hancock, Austin Garcia, Jacob Shedenhelm, Jordan Cowen, and Calista Carey. Cirq: A python framework for creating, editing, and invoking quantum circuits
-
[20]
Pennylane: Automatic differentiation of hybrid quantum-classical computations
Ville Bergholm, Josh Izaac, Maria Schuld, Christian Gogolin, Shahnawaz Ahmed, Vishnu Ajith, M Sohaib Alam, Guillermo Alonso-Linaje, B AkashNarayanan, Ali Asadi, et al. Pennylane: Automatic differentiation of hybrid quantum-classical computations. arXiv preprint arXiv:1811.0496...
2018 arXiv
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.