From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution

Hu Wei

arxiv: 2604.11378 · v1 · submitted 2026-04-13 · 💻 cs.AI · cs.SY· eess.SY

From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution

Hu Wei This is my paper

Pith reviewed 2026-05-10 15:18 UTC · model grok-4.3

classification 💻 cs.AI cs.SYeess.SY

keywords LLM agentsagent loopsstructured graphsDAG executionscheduling theorycontrollabilityrecovery protocolsverifiability

0 comments

The pith

LLM agent execution improves when control flow is lifted from implicit loops into explicit immutable static graphs.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper identifies three structural problems in the standard agent loop for LLM agents: hidden step dependencies, unbounded recovery attempts, and mutable history that hinders debugging. It reframes the loop as a single ready unit scheduler whose next choice depends on opaque model inference. The proposed Structured Graph Harness replaces this with a fixed DAG that encodes the plan, separates planning execution and recovery into distinct layers, and enforces a strict escalation protocol for failures. This design trades some runtime flexibility for inspectability and formal guarantees, backed by a scheduler unified view, a survey of existing systems, a node state machine specification, and an outlined experimental protocol.

Core claim

Agent loops amount to single ready unit schedulers whose nondeterministic choices come from LLM inference rather than policy. The Structured Graph Harness converts that implicit control into an explicit static DAG whose execution plan is immutable within each version, whose planning execution and recovery duties occupy three separate layers, and whose failures obey a strict escalation protocol. These commitments deliver controllability, verifiability, and implementability while the paper supplies the supporting scheduler framework, trade-off analysis across surveyed systems, formal termination and soundness guarantees, and a seven-group experimental design for validation.

What carries the argument

The Structured Graph Harness (SGH), an explicit static directed acyclic graph that encodes an immutable execution plan and separates planning, execution, and recovery into distinct layers with an escalation protocol.

If this is right

Execution histories become versioned and inspectable, enabling systematic debugging and auditing.
Recovery paths are bounded and protocol-driven rather than open-ended loops.
Classical scheduling algorithms can be applied to optimize resource allocation across agent nodes.
Formal termination and soundness properties hold for the node state machine.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

The same graph structure could support hybrid execution where deterministic sub-plans are handled by non-LLM schedulers.
Standardized graph formats might allow portable agent definitions across different LLM back-ends.
Dynamic plan refinement could be added as a controlled version update while preserving immutability within a version.

Load-bearing premise

The reduced expressiveness from immutable plans and strict layering will remain acceptable for most practical LLM agent tasks and the gains in controllability will outweigh the restrictions.

What would settle it

A controlled comparison on a set of multi-step agent benchmarks in which an SGH implementation either solves fewer tasks than a matched agent loop or requires materially more tokens and retries to reach equivalent success rates.

Figures

Figures reproduced from arXiv: 2604.11378 by Hu Wei.

**Figure 2.** Figure 2: The scheduler continuum (extended). The new “Parallel Loop” category represents Agent [PITH_FULL_IMAGE:figures/full_fig_p014_2.png] view at source ↗

**Figure 3.** Figure 3: Three-layer separation: planning, execution, and recovery. [PITH_FULL_IMAGE:figures/full_fig_p023_3.png] view at source ↗

**Figure 4.** Figure 4: Node state machine. Terminal states (gray) are stable: once entered, they are never [PITH_FULL_IMAGE:figures/full_fig_p024_4.png] view at source ↗

read the original abstract

The dominant paradigm for building LLM based agents is the Agent Loop, an iterative cycle where a single language model decides what to do next by reading an ever growing context window. This paradigm has three structural weaknesses: implicit dependencies between steps, unbounded recovery loops, and mutable execution history that complicates debugging. We characterize the Agent Loop as a single ready unit scheduler: at any moment, at most one executable unit is active, and the choice of which unit to activate comes from opaque LLM inference rather than an inspectable policy. This perspective places Agent Loops and graph based execution engines on a single semantic continuum. We propose SGH, Structured Graph Harness, which lifts control flow from implicit context into an explicit static DAG. SGH makes three commitments: execution plans are immutable within a plan version, planning execution and recovery are separated into three layers, and recovery follows a strict escalation protocol. These choices trade some expressiveness for controllability, verifiability, and implementability. Our contributions are fourfold: a scheduler unified framework that applies classical scheduling theory to LLM agent execution and identifies challenges introduced by non deterministic LLM nodes; a trade off analysis of controllability, expressiveness, and implementability across 70 surveyed systems; a formal specification including a node state machine with termination and soundness guarantees; and an attributable experimental framework with a seven group design for future validation. This is a position paper and design proposal. We provide a theoretical framework, design analysis, and experimental protocol, not a production implementation or empirical results.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

This position paper reframes agent loops as schedulers and proposes SGH with three explicit commitments, but supplies only an outline without implementation or results.

read the letter

The main point to know is that this paper treats the common agent loop as a kind of single-unit scheduler and introduces SGH, a structured graph harness that makes plans explicit, immutable within versions, and separated into planning, execution, and recovery layers with strict escalation. It does some things solidly. The scheduler-theoretic view connects agent loops to classical scheduling and graph engines in a single framework, which helps organize the space. The analysis of 70 systems provides a comparative look at controllability, expressiveness, and implementability. The formal specification includes a node state machine along with termination and soundness guarantees in outline form. They also lay out an attributable experimental framework with seven groups for future testing. These pieces give the proposal some grounding even without running code. The limitations are clear and expected for this type of work. There is no implementation or data, so the practical impact of the three commitments remains speculative. We cannot verify if the reduced expressiveness from immutable plans is acceptable or if the recovery protocol improves reliability as hoped. The guarantees are stated but would need full proofs or checks to be convincing. The paper acknowledges it is a design proposal, not a completed system. This work is aimed at researchers and engineers building LLM-based agents who are concerned with debugging, reliability, and verifiability. Anyone thinking about moving beyond ad-hoc loops would get value from the framing and the specific design choices. It makes sense to send it for serious peer review so that referees can comment on the framework's strengths and suggest how to strengthen the formal parts or the validation plan. I recommend proceeding with peer review rather than a desk reject.

Referee Report

3 major / 2 minor

Summary. The manuscript characterizes the dominant Agent Loop paradigm for LLM agents as a single-ready-unit scheduler with implicit dependencies, unbounded recovery loops, and mutable execution history. It unifies this with graph-based engines on a semantic continuum and proposes the Structured Graph Harness (SGH) as an explicit static DAG that makes three commitments: immutable execution plans within a plan version, separation of planning/execution/recovery into three layers, and strict escalation for recovery. Contributions include a scheduler-theoretic unified framework applying classical scheduling theory to non-deterministic LLM nodes, a trade-off analysis across 70 surveyed systems, a formal node state machine with claimed termination and soundness guarantees, and a seven-group experimental protocol for future validation. The work is presented explicitly as a position paper and design proposal without implementation or empirical results.

Significance. If the SGH commitments and formal guarantees hold under implementation, the framework could meaningfully advance LLM agent design by increasing controllability, verifiability, and debuggability through explicit static graphs and layered recovery, while bridging scheduling theory with agent execution. The survey of 70 systems provides a useful taxonomy of the expressiveness-controllability trade-off, and the node state machine plus experimental protocol offer concrete foundations for subsequent work. The paper earns credit for its explicit design commitments, the continuum perspective, and the reproducible experimental protocol, even absent current validation.

major comments (3)

[Formal specification] Formal specification (node state machine section): The manuscript claims termination and soundness guarantees for the node state machine, yet supplies only an outline of states and transitions without transition rules, invariants, or a proof sketch; this is load-bearing for the central verifiability claim and cannot be assessed from the given commitments alone.
[Trade-off analysis] Trade-off analysis (survey of 70 systems): The analysis identifies controllability/expressiveness tensions but reports no quantitative metrics, scoring rubric, or per-system classification table that would allow readers to evaluate whether the three SGH commitments actually improve the trade-off for typical tasks; this underpins the weakest assumption that reduced expressiveness will be acceptable.
[Experimental framework] Experimental framework (seven-group protocol): The protocol is described at a high level but does not define concrete success metrics (e.g., recovery latency, debug time, or failure rate) or how the groups will isolate the effects of immutability versus layering versus escalation; without these, the protocol cannot serve as a falsifiable validation plan.

minor comments (2)

[Abstract] Abstract: The term 'attributable experimental framework' is introduced without immediate definition or reference to the later protocol, which may confuse readers expecting empirical results.
The manuscript would benefit from a single summary table or diagram placing the 70 surveyed systems along the scheduler-to-graph continuum to make the taxonomy immediately usable.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive and detailed review of our position paper. We address each major comment below and will revise the manuscript accordingly to strengthen the presentation of the SGH framework.

read point-by-point responses

Referee: [Formal specification] Formal specification (node state machine section): The manuscript claims termination and soundness guarantees for the node state machine, yet supplies only an outline of states and transitions without transition rules, invariants, or a proof sketch; this is load-bearing for the central verifiability claim and cannot be assessed from the given commitments alone.

Authors: We agree that the current high-level outline does not fully substantiate the termination and soundness claims. Although this is a position paper proposing a design framework rather than a completed formal verification, we will revise the node state machine section to include explicit transition rules, the principal invariants preserved across states, and a proof sketch establishing termination under the escalation protocol together with soundness relative to the immutable execution plan. These additions will make the verifiability claims directly assessable. revision: yes
Referee: [Trade-off analysis] Trade-off analysis (survey of 70 systems): The analysis identifies controllability/expressiveness tensions but reports no quantitative metrics, scoring rubric, or per-system classification table that would allow readers to evaluate whether the three SGH commitments actually improve the trade-off for typical tasks; this underpins the weakest assumption that reduced expressiveness will be acceptable.

Authors: We accept that the trade-off analysis would be more persuasive with concrete supporting material. In the revision we will introduce a lightweight scoring rubric that evaluates systems along controllability, expressiveness, and implementability dimensions keyed to the three SGH commitments. We will also add a classification table for a representative subset of the surveyed systems and report aggregate metrics illustrating the observed trade-offs. This will enable readers to evaluate the claim that the commitments yield a favorable balance for many tasks. revision: yes
Referee: [Experimental framework] Experimental framework (seven-group protocol): The protocol is described at a high level but does not define concrete success metrics (e.g., recovery latency, debug time, or failure rate) or how the groups will isolate the effects of immutability versus layering versus escalation; without these, the protocol cannot serve as a falsifiable validation plan.

Authors: We thank the referee for highlighting this gap. The seven-group protocol is offered as a template for subsequent empirical studies rather than a completed experiment. In the revision we will define concrete success metrics (recovery latency, debugging time, and failure rate) and specify the group structure and controls needed to isolate the individual contributions of immutability, layering, and escalation. These clarifications will render the protocol falsifiable and ready for direct implementation. revision: yes

Circularity Check

0 steps flagged

No significant circularity; design proposal with no fitted parameters or self-referential derivations

full rationale

The paper is a position paper and design proposal that characterizes the Agent Loop paradigm as a single-ready-unit scheduler using classical scheduling concepts, then proposes SGH via three explicit design commitments (immutable plans, three-layer separation, strict escalation) and a node state machine specification. No equations, fitted parameters, predictions derived from inputs, or self-citations appear in the provided text or abstract. The framework unifies existing ideas on a semantic continuum and supplies an experimental protocol for future validation rather than claiming empirical results or deriving new quantities from its own assumptions. All load-bearing steps remain independent of the proposal itself, with trade-offs left open for external assessment.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 2 invented entities

The central proposal rests on domain assumptions about LLM non-determinism and the value of trading expressiveness for controllability; no free parameters or independently evidenced invented entities are introduced beyond the named framework itself.

axioms (2)

domain assumption LLM inference nodes introduce non-determinism that must be handled by the scheduler
Explicitly identified as a challenge that the framework must address.
ad hoc to paper Immutable plans and layered recovery improve verifiability more than they reduce useful expressiveness
Core design choice stated as a deliberate trade-off.

invented entities (2)

Structured Graph Harness (SGH) no independent evidence
purpose: Explicit static DAG execution engine for LLM agents
Newly proposed system; no independent evidence supplied.
Three-layer separation (planning, execution, recovery) no independent evidence
purpose: Enforce separation of concerns and strict escalation
Invented architectural commitment; no external validation.

pith-pipeline@v0.9.0 · 5569 in / 1507 out tokens · 65121 ms · 2026-05-10T15:18:00.347864+00:00 · methodology

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

CAX-Agent: A Lightweight Agent Harness for Reliable APDL Automation
cs.AI 2026-05 unverdicted novelty 5.0

CAX-Agent is a three-layer agent harness for MAPDL automation whose model-driven recovery policy reaches 0.93 task completion and 0.84 zero-intervention rate on 50 simple structural benchmarks, outperforming rule-only...

Reference graph

Works this paper leans on

9 extracted references · 9 canonical work pages · cited by 1 Pith paper

[1]

El agente gr´ afico: Structured execution graphs for scientific agents.arXiv preprint arXiv:2602.17902,

Jiaru Bai, Abdulrahman Aldossary, Thomas Swanick, Marcel M¨ uller, Yeonghun Kang, Zijian Zhang, Jin Won Lee, Tsz Wai Ko, Mohammad Ghazi Vakili, Varinia Bernales, and Al´ an Aspuru- Guzik. El agente gr´ afico: Structured execution graphs for scientific agents.arXiv preprint arXiv:2602.17902,

work page arXiv
[2]

Beyond entangled planning: Task-decoupled planning for long-horizon agents,

Yunfan Li, Bingbing Xu, Xueyun Tian, Xiucheng Xu, and Huawei Shen. Beyond entangled plan- ning: Task-decoupled planning for long-horizon agents.arXiv preprint arXiv:2601.07577,

work page arXiv
[3]

arXiv preprint arXiv:2507.21407

Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, and Shirui Pan. Graph-augmented large language model agents: Current progress and future prospects.arXiv preprint arXiv:2507.21407,

work page arXiv
[4]

Agentkit: Structured llm reasoning with dynamic graphs.arXiv preprint arXiv:2404.11483,

Yue Wu, Yewen Fan, So Yeon Min, Shrimai Prabhumoye, Stephen McAleer, Yonatan Bisk, Ruslan Salakhutdinov, Yuanzhi Li, and Tom Mitchell. Agentkit: Structured llm reasoning with dynamic graphs.arXiv preprint arXiv:2404.11483,

work page arXiv
[5]

DynTaskMAS : A dynamic task graph-driven framework for asynchronous and parallel LLM -based multi-agent systems

Junwei Yu, Yepeng Ding, and Hiroyuki Sato. Dyntaskmas: A dynamic task graph-driven framework for asynchronous and parallel llm-based multi-agent systems.arXiv preprint arXiv:2503.07675,

work page arXiv
[6]

From static templates to dynamic runtime graphs: A survey of workflow optimization for llm agents.arXiv preprint arXiv:2603.22386, 2026

Ling Yue, Kushal Raj Bhandari, Ching-Yun Ko, Dhaval Patel, Shuxin Lin, Nianjun Zhou, Jianxi Gao, Pin-Yu Chen, and Shaowu Pan. From static templates to dynamic runtime graphs: A survey of workflow optimization for llm agents.arXiv preprint arXiv:2603.22386,

work page arXiv
[7]

Routine: A structural planning framework for llm agent system in enterprise,

Guancheng Zeng, Xueyi Chen, Jiawang Hu, Shaohua Qi, Yaxuan Mao, Zhantao Wang, Yifan Nie, Shuang Li, Qiuyang Feng, Pengxu Qiu, Yujia Wang, Wenqiang Han, Linyan Huang, Gang Li, Jingjing Mo, and Haowen Hu. Routine: A structural planning framework for llm agent system in enterprise.arXiv preprint arXiv:2507.14447,

work page arXiv
[8]

G-designer: Architecting multi-agent communication topologies via graph neural networks.arXiv preprint arXiv:2410.11782, 2024

43 Guibin Zhang, Yanwei Yue, Xiangguo Sun, Guancheng Wan, Miao Yu, Junfeng Fang, Kun Wang, Tianlong Chen, and Dawei Cheng. G-designer: Architecting multi-agent communication topolo- gies via graph neural networks.arXiv preprint arXiv:2410.11782, 2025a. Jiayi Zhang, Jinyu Xiang, Zhaoyang Yu, Fengwei Teng, Xionghui Chen, Jiaqi Chen, Mingchen Zhuge, Xin Chen...

work page arXiv
[9]

one suffices

A Formal Specifications A.1 Complete State Transition Table Table 15 lists all valid state transitions for a nodev∈V. Table 15: Complete state transition table. From To Trigger Condition pending readyDependencies satisfied∀p∈dep(v) :σ(p)∈Σ +term ready runningScheduler dispatch Selected byP ready blockedDependency lost A predecessor left terminal-success s...

work page 2026

[1] [1]

El agente gr´ afico: Structured execution graphs for scientific agents.arXiv preprint arXiv:2602.17902,

Jiaru Bai, Abdulrahman Aldossary, Thomas Swanick, Marcel M¨ uller, Yeonghun Kang, Zijian Zhang, Jin Won Lee, Tsz Wai Ko, Mohammad Ghazi Vakili, Varinia Bernales, and Al´ an Aspuru- Guzik. El agente gr´ afico: Structured execution graphs for scientific agents.arXiv preprint arXiv:2602.17902,

work page arXiv

[2] [2]

Beyond entangled planning: Task-decoupled planning for long-horizon agents,

Yunfan Li, Bingbing Xu, Xueyun Tian, Xiucheng Xu, and Huawei Shen. Beyond entangled plan- ning: Task-decoupled planning for long-horizon agents.arXiv preprint arXiv:2601.07577,

work page arXiv

[3] [3]

arXiv preprint arXiv:2507.21407

Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, and Shirui Pan. Graph-augmented large language model agents: Current progress and future prospects.arXiv preprint arXiv:2507.21407,

work page arXiv

[4] [4]

Agentkit: Structured llm reasoning with dynamic graphs.arXiv preprint arXiv:2404.11483,

Yue Wu, Yewen Fan, So Yeon Min, Shrimai Prabhumoye, Stephen McAleer, Yonatan Bisk, Ruslan Salakhutdinov, Yuanzhi Li, and Tom Mitchell. Agentkit: Structured llm reasoning with dynamic graphs.arXiv preprint arXiv:2404.11483,

work page arXiv

[5] [5]

DynTaskMAS : A dynamic task graph-driven framework for asynchronous and parallel LLM -based multi-agent systems

Junwei Yu, Yepeng Ding, and Hiroyuki Sato. Dyntaskmas: A dynamic task graph-driven framework for asynchronous and parallel llm-based multi-agent systems.arXiv preprint arXiv:2503.07675,

work page arXiv

[6] [6]

From static templates to dynamic runtime graphs: A survey of workflow optimization for llm agents.arXiv preprint arXiv:2603.22386, 2026

Ling Yue, Kushal Raj Bhandari, Ching-Yun Ko, Dhaval Patel, Shuxin Lin, Nianjun Zhou, Jianxi Gao, Pin-Yu Chen, and Shaowu Pan. From static templates to dynamic runtime graphs: A survey of workflow optimization for llm agents.arXiv preprint arXiv:2603.22386,

work page arXiv

[7] [7]

Routine: A structural planning framework for llm agent system in enterprise,

Guancheng Zeng, Xueyi Chen, Jiawang Hu, Shaohua Qi, Yaxuan Mao, Zhantao Wang, Yifan Nie, Shuang Li, Qiuyang Feng, Pengxu Qiu, Yujia Wang, Wenqiang Han, Linyan Huang, Gang Li, Jingjing Mo, and Haowen Hu. Routine: A structural planning framework for llm agent system in enterprise.arXiv preprint arXiv:2507.14447,

work page arXiv

[8] [8]

G-designer: Architecting multi-agent communication topologies via graph neural networks.arXiv preprint arXiv:2410.11782, 2024

43 Guibin Zhang, Yanwei Yue, Xiangguo Sun, Guancheng Wan, Miao Yu, Junfeng Fang, Kun Wang, Tianlong Chen, and Dawei Cheng. G-designer: Architecting multi-agent communication topolo- gies via graph neural networks.arXiv preprint arXiv:2410.11782, 2025a. Jiayi Zhang, Jinyu Xiang, Zhaoyang Yu, Fengwei Teng, Xionghui Chen, Jiaqi Chen, Mingchen Zhuge, Xin Chen...

work page arXiv

[9] [9]

one suffices

A Formal Specifications A.1 Complete State Transition Table Table 15 lists all valid state transitions for a nodev∈V. Table 15: Complete state transition table. From To Trigger Condition pending readyDependencies satisfied∀p∈dep(v) :σ(p)∈Σ +term ready runningScheduler dispatch Selected byP ready blockedDependency lost A predecessor left terminal-success s...

work page 2026