Pith. sign in

REVIEW 5 major objections 6 minor 45 references

On Optimal Event-Triggered Distributed Control for Stochastic Multi-Agent Systems via Reinforcement Learning

T0 review · 5 major / 6 minor · reviewed 2026-08-01 · deepseek-v4-flash

Pith's one-line read This paper claims a unified RL-based optimal distributed control for stochastic multi-agent systems that keeps all tracking errors bounded and avoids Zeno behavior through a hybrid event-triggered strategy.

desk verdict New combination, broken proof: the K_u metric is worth a look, but the optimality derivation and Theorem 1's SGUUB/Zeno-free argument don't survive their own equations. read the letter →

arxiv 2607.17635 v1 pith:MZSGEHXD submitted 2026-07-20 eess.SY cs.SY

classification eess.SYcs.SY MSC 93A1693D0593E2093C57
keywords event-triggeredcontrolstochasticmulti-agentsystemsreinforcementlearningactor-critic-identifierbacksteppingconsensustrackingneuralnetworksoptimal
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to prove that a distributed controller for stochastic leader-following multi-agent systems can be simultaneously optimal (in a reinforcement-learning sense), robust to unknown stochastic dynamics and non-affine faults, and event-triggered with a guaranteed minimum time between control updates. The design runs backstepping with an actor-critic-identifier neural network at every step; each virtual controller and the final controller are chosen to satisfy a Hamilton-Jacobi-Bellman optimality condition. The main theorem states that all tracking and neural-network errors are semi-globally uniformly ultimately bounded, and that the hybrid event-triggering rule (static threshold when the control magnitude is large, dynamic threshold when it is small) excludes Zeno behavior. The paper further introduces a composite index, borrowing the idea of benchmark normalization from economics, to compare triggered versus continuous control on trigger count, tracking error, and control effort. If the theorem is correct, the algorithm offers a concrete recipe for sparse, fault-tolerant distributed control.

What carries the argument

The central mechanism is the hybrid event-triggered control law with a switching threshold H_g. At triggering instants the control is held constant. Inside each inter-execution interval, the held value κ_i is related to the current optimal control u*_i by a time-varying proportional-plus-offset representation κ_i = (1 + ϖ_1 ϱ_i) u*_i + ϖ_2 λ*_i, with |ϖ_1|, |ϖ_2| ≤ 1. This representation, together with the tanh inequality 0 ≤ |x| − x tanh(x/χ) ≤ 0.2785χ, is what converts the triggering error into a residual bounded by a constant (0.557Υ_i or 0.2785Υ_i) in the Lyapunov derivative. The backstepping loops are then closed using radial-basis-function neural networks (actor, critic, identifier) wh

What would settle it

Take the saturated controller from (19), κ_i = −(1+ϱ_i)(u*_i tanh(u*_i z_i,n/Υ_i) + ϱ̄_i tanh(ϱ̄_i z_i,n/Υ_i)), and test numerically whether there exist functions ϖ_1(t), ϖ_2(t) in [−1,1] such that κ_i(t) equals (1+ϖ_1ϱ_i)u*_i + ϖ_2λ*_i along a simulated trajectory. If equality fails for any time instant, inequality (25) does not follow. Similarly, compute Δ from (30) over the same trajectory; if Δ varies with z_i,k and neural-network weights rather than staying constant, the final exponential bound (31) cannot be derived.

Watch

Extended reading notes

Core claim

At the center of the paper is a claim: with the proposed actor-critic-identifier backstepping design and the hybrid event-triggered update law (17)-(19), every follower in stochastic multi-agent system (1) tracks the leader's desired trajectory in the sense that all errors in the closed loop are SGUUB, and the sequence of controller update times has a positive uniform lower bound (no Zeno behavior). The optimality claim is that each backstepping virtual controller and the final control input solve the HJB condition ∂H/∂u* = 0 for its local performance index. The proof proceeds by a Lyapunov function that mixes quartic tracking error terms with quadratic neural-network weight errors, and conv

Load-bearing premise

The proof's error bound depends on representing the event-triggered controller as κ_i(t) = (1 + ϖ_1(t)ϱ_i)u*_i(t) + ϖ_2(t)λ*_i with bounded time-varying coefficients and on treating the residual term Δ in inequality (29) as a constant; the first representation does not match the saturated controller (19) and the displayed Δ contains state- and weight-dependent terms, so the exponential bound in (31) does not follow from the written proof.

Editorial extensions

If this is right

  • If Theorem 1 is correct, a group of agents with stochastic disturbances and unknown non-affine faults can achieve practical leader-following consensus with no centralized coordinator and with control inputs updated only at discrete events.
  • The positive minimum inter-execution interval excludes Zeno behavior, so the event-triggered implementation is physically realizable without accumulating updates in finite time.
  • Optimality at each backstepping step means the learned virtual and actual control policies are local minimizers of their performance indices, a property the paper argues is absent in non-optimized backstepping consensus.
  • The benchmark-normalized index K_u gives a single scalar for trading off communication savings against tracking accuracy and actuator wear, enabling designers to choose thresholds by weighting α, β, γ.
  • The simulation results suggest that the hybrid ETC can reduce controller activation frequency by roughly 80% or more compared with continuous updating while keeping the combined index near 1.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The per-step HJB optimality is local optimality of each backstepping virtual controller, not a global optimality certificate for the full multi-agent consensus problem; treating 'optimal distributed control' as global would overread the claim.
  • The saturation in (19) is a tanh-based approximation of the sign/linear law; if the proof's linear-representation shortcut fails, the stability conclusion may still be recoverable through a more direct Lyapunov analysis of the saturated error, but that is not what the paper shows.
  • The K_u index is a portable measurement tool: it could be applied to any event-triggered consensus controller to compare designs on the same three-axis trade-off, independent of the neural-network specifics.
  • A natural testable extension is to vary H_g and the weighting (α, β, γ) in the simulation to map the Pareto frontier of communication savings versus tracking accuracy; the paper gives the tool but does not explore the trade-off surface.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 6 minor

Summary. The paper proposes a distributed leader-following consensus controller for stochastic nonlinear multi-agent systems subject to fault-induced uncertainties. The design combines backstepping with an RL-based actor-critic-identifier architecture and a hybrid event-triggering strategy. The authors claim that, at each backstepping step, the virtual and actual control laws are optimal solutions of the associated HJB equations, that all closed-loop errors are SGUUB, and that the event-triggered scheme is Zeno-free. A simulation study on a single-axis robotic manipulator compares the proposed controller with a non-optimal baseline and introduces a weighted economic index K_u for evaluating event-triggered performance.

Significance. If the theoretical claims were correct, the paper would address an active and difficult problem: simultaneously handling stochastic disturbances and non-affine faults in distributed multi-agent systems while preserving some notion of optimality and event-triggered resource savings. The simulation section is clearly presented, includes a practical robotic example, and proposes an interesting quantitative ETC evaluation index K_u. However, the core theoretical contributions are not established. The optimality derivation is internally inconsistent, and the stability proof relies on unsupported algebraic representations and treats a state-dependent quantity as a constant. These are load-bearing flaws affecting the central claims of Theorem 1, so the paper cannot be accepted in its current form.

major comments (5)
  1. [Section III-A, Eqs. (8)-(13)] The expressions for the HJB derivative dJ*/dz are mutually inconsistent. Substituting (9) into (8) gives u* = -(1/(2 eta_i))(zeta z + J0 + 2h*). With the NN approximations (11), this becomes u* approximately -(1/(2 eta_i))(zeta z + W_J^T Q_J + 2W_h^T Q_h). The implemented controller (12) is u_hat* = -(1/eta_i)(zeta z + W_hat_h^T Q_h + 0.5 W_hat_u^T Q_J), which would correspond to dJ*/dz = (1/eta_i^2)(2 zeta z + 2 W_hat_h^T Q_h + W_hat_u^T Q_J). This differs by a factor of 2 on the zeta z term and replaces the J0 approximation by W_hat_u. Equation (13) gives yet a third expression, dJ*/dz = (1/eta_i^2)(2 zeta z + 2 W_hat_h^T Q_h + W_hat_c^T Q_J). Thus the 'optimal' controller (12) does not follow from the HJB solution (8)-(9), and the critic expression (13) contradicts (9). The optimality claim is therefore unsupported.
  2. [Section III-C, Eqs. (29)-(31)] The application of Lemma 3 is invalid because Delta in Eq. (30) is not a constant. Lemma 3 requires V_dot <= -Psi1 V + Psi2 with Psi1, Psi2 positive constants, and Eq. (31) uses Delta/Weierstrass-p as a uniform ultimate bound. However, Delta in (30) explicitly contains state- and weight-dependent terms: sum 0.5 z_{i,k}^6, sum 0.25 (W_hat_{u_i,k}^T Q_{J_i,k})^2, and sum z_{i,k+1}^4. These positive nonlinearities are not canceled by the negative terms in (28), which are of order z^4 and quadratic in the weight errors. For sufficiently large |z| or ||W_hat||, V_dot can become positive, so no SGUUB bound follows from (29). Bounding Delta by a constant would require the very a priori bounds the theorem is supposed to establish, which is circular. Consequently, the exponential bound (31) and the SGUUB conclusion are not proven.
  3. [Section III-C, before Eq. (25); Eq. (19)] The event-triggering error analysis rests on a representation that contradicts the actual controller. The proof assumes that when |u_i| >= H_g, kappa_i(t) = (1 + varpi_1(t) rho_i) u*_i(t) + varpi_2(t) lambda*_i with |varpi_1|, |varpi_2| <= 1. But the controller actually defined in (19) is kappa_i = -(1+rho_i)(u*_i tanh(u*_i z_{i,n}/Upsilon_i) + bar_rho_i tanh(bar_rho_i z_{i,n}/Upsilon_i)). This is a saturated nonlinear function of u*_i, not a linear function. For u*_i = 0, (19) gives kappa_i = -(1+rho_i)bar_rho_i tanh(bar_rho_i z/Upsilon), whereas the assumed representation gives varpi_2 lambda*, which may be nonzero. For large |u*|, the representation grows linearly while (19) saturates. Hence the bound (25) does not follow from Lemma 1, and the ETC-related terms entering (28) are unsupported. The subsequent Zeno-free conclusion, which depends on (25) and on a bound for pi_dot, is also
  4. [Section III-C, Lyapunov proof, Eq. (28)] The stability proof ignores the stochastic nature of the system. The plant in (1) is driven by a Wiener process, yet the proof computes only the deterministic derivative V_dot in (28). For stochastic differential equations, the infinitesimal generator must include the second-order Ito correction term (1/2)Tr(sigma^T V_xx sigma). Such a term appears in the HJB derivation (7) but is absent from the Lyapunov analysis. Lemma 3 is stated for the infinitesimal generator, but the proof does not compute it. Therefore the claim that all errors are SGUUB in mean square is not justified. This is a separate, load-bearing gap from the Delta issue.
  5. [Section III-A, Eqs. (4)-(14)] The paper's central claim of 'optimality' is constructed rather than derived. The decomposition (9) is tautological: J0_{i,1} is defined as the leftover of eta_i^2 dJ*/dz - 2 zeta z - 2h*, so (9) holds for any choice of zeta and h*. The NN approximation of J0 then merely replaces an unknown quantity with a basis-function expansion, and no HJB residual is minimized. The critic and actor update laws (12)-(14) are chosen for Lyapunov stability, not to drive the Hamiltonian or any optimality error to zero. Thus the controller (12)/(16) is an adaptive backstepping law with adjustable gains, and the label 'optimal' is not supported by any optimization step. This concern affects the main contribution claimed in the abstract and introduction.
minor comments (6)
  1. [Sections II-III] The abstract and introduction mention a 'low-pass filter' that 'effectively suppresses problems stemming from non-affine nonlinear faults', but no low-pass filter appears in the design equations (12)-(19) or in the stability proof. The claim is never substantiated.
  2. [Section IV, Parameter Setting] The simulation parameters phi_{u_i,k}=13 and phi_{c_i,k}=15 violate the design condition stated in Sections III-A and III-B, which requires phi_u > phi_c > phi_u/2. With 13 < 15, the parameter condition used in the Lyapunov analysis is not satisfied in the experiment.
  3. [Eqs. (4)-(6)] The notation for the running cost is inconsistent: Eq. (4) uses o_{i,1}, while Eqs. (5)-(6) use h_{i,1}. The relationship between o, h, and the earlier value function is not clarified.
  4. [Eq. (8)] In Eq. (8), the left-hand side is written as u*_{i,k}, but the right-hand side depends on J*_{i,1}; this appears to be an indexing error. It should be u*_{i,1} in Step 1, and analogous expressions for later steps should be stated consistently.
  5. [Section III-C, Zeno-free proof] The final paragraph of the proof of Theorem 1 asserts that there exists a constant Lambda_i such that t* >= max{lambda_i, rho_i |u_i| + lambda*_i}/Lambda_i, but no argument is given for the existence or boundedness of Lambda_i. A rigorous Zeno-free proof requires a bound on the growth rate of pi_i, which is not established.
  6. [Section III-C, Eq. (25)] The inequality (25) uses the numerical constant 0.557 Upsilon_i, apparently from 2 times 0.2785 Upsilon_i, but Lemma 1 is stated for |chi| - chi tanh(chi/chi_2) <= epsilon* chi_2 with epsilon* approximately 0.2785. The manuscript does not show how the two tanh terms in (19) lead to the stated factor of 0.557 in the presence of the factor (1+rho_i).

Circularity Check

2 steps flagged · score 6.0 of 10

Optimality is constructed via the tautological Eq. (9), and the SGUUB proof treats the state-dependent residual Δ as a constant, making the two load-bearing claims circular.

  1. self definitional [Section III-A, Step 1, Eqs. (8)-(13)]
    "Then, the optimal virtual controller u*_{i,1} can be derived by solving equation ∂H_{i,1}/∂u*_{i,1}=0 as u*_{i,k}=−η_i/2 dJ*_{i,1}/dz_{i,1}. (8) ... we introduce the consensus error term (dJ*_{i,1}/dz_{i,1}) with a designed positive parameter ζ_{i,1} as dJ*_{i,1}/dz_{i,1}=1/η_i^2(ζ_{i,1}z_{i,1}+J'_{i,1}+2h*_{i,1}), (9) where J'_{i,1}=η_i^2 dJ*_{i,1}/dz_{i,1}−2ζ_{i,1}z_{i,1}−2h*_{i,1}. (10)"

    Substituting (10) into (9) makes (9) an identity, so dJ*/dz is not being determined by the HJB stationarity condition (8); any desired backstepping controller can be represented this way by choosing ζ and the NN terms. The subsequent 'optimal' virtual controller (12) is therefore the chosen stabilizing law relabeled as optimal, and the HJB equation (6) is never verified after the NN substitutions. The critic update in (13) is only ˙W_c = −φ_c Q^T Q W_c, with no cost or value term, so the 'critic' does not evaluate J*. The claimed derivation of optimal control reduces by construction to the designer's choice of ζ and NN functions.

  2. other [Section III-C, Theorem 1 proof, Eqs. (28)-(31)]
    "Then we have \V\dot≤−℘V+Δ (29) where ℘=min{4ζ_{i,k}, φ_{u_i,k}Θ_min(J), φ_{c_i,k}Θ_min(J), σ_{i,k}/Θ_max(δ)}, Δ=Σ[(ρ^2_{h_i,k}+z^6_{i,k})/2 + (\W\hat^T_{u_i,k}Q_{J_i,k})^2/4 + η_i z^4_{i,2}/4 + z^4_{i,k+1} + ...] + Σ 0.8355Υ_i. (30) And (30) satisfies 0≤V(t)≤e^{−℘t}V(0)+Δ/℘. (31)"

    Lemma 3 requires V\dot≤−Ψ_1 V+Ψ_2 with Ψ_1,Ψ_2 constants to conclude the exponential bound (23). Here Δ in (30) explicitly contains z^6_{i,k}, z^4_{i,k+1}, and (\W\hat^T_{u_i,k}Q_{J_i,k})^2, which are functions of the tracking errors and NN weight estimates, not constants. Passing from (29) to (31) requires bounding Δ by a constant independent of the state and weights, and that bound is exactly the a priori SGUUB boundedness of z_{i,k} and \W\hat_{u_i,k} that Theorem 1 is meant to prove. Thus the SGUUB conclusion is used to justify the very bound needed for the proof.

full rationale

The paper is not built on a self-citation chain: Lemma 3 is a standard stochastic Lyapunov result, and the simulation provides an external benchmark. However, the two load-bearing theoretical reductions are circular. First, the claimed HJB-derived optimal controller is not actually derived from the HJB equation: Eq. (9) introduces dJ*/dz through an identity, because J' is defined in Eq. (10) to make Eq. (9) tautologically true, and the subsequent NN and actor/critic updates are selected for Lyapunov stability rather than to satisfy ∂H/∂u*=0 or to minimize J*. The critic update (13) contains no value or cost term, so the 'optimal' label is attached to the chosen stabilizing backstepping controller by construction. Second, Theorem 1's SGUUB proof applies Lemma 3 to inequality (29), but the residual Δ in (30) contains state- and weight-dependent terms (z^6, z^4, (\W\hat^T Q)^2); converting (29) into the exponential bound (31) requires Δ to be a constant, which in turn requires the a priori boundedness of the states and weights—exactly the conclusion being proven. There are additional non-circular mathematical gaps, such as the linear representation of κ_i used at (25) being inconsistent with the saturated controller (19), but those are correctness concerns rather than circularity. Accordingly, the central optimality claim and the stability proof each reduce by construction to their own assumptions, yielding a partial circularity score of 6.

Assumptions & free parameters 6 free parameters · 8 assumptions · 1 invented entities

The paper's claimed contribution (a provably optimal, event-triggered, RL-based scheme) rests on a large stack of hand-set gains (ζ, φ, δ, σ, all ETC thresholds, αβγ) and unspecified NN bases, plus two ad hoc mathematical assertions in the proof of Theorem 1 (the ϖ-representation of the saturated controller and the constancy of Δ). Assumptions 1-2 and Lemmas 1-3 are standard background. No new physical entities are posited; the only novel object is the K_u index, which is defined on the validation data itself.

free parameters (6)
  • ζ_{i,k} (tracking/consensus gain in the 'optimal' controller) = 1.2
    Introduced in Eq. (9) as the 'designed positive parameter' that prescribes the shape of dJ*/dz and hence defines the 'optimal' controller (12); hand-chosen in Section IV. The factor-of-2 discrepancy between (9) and (13) shows the claim is a gain choice, not a derivation.
  • φ_{ui,k}, φ_{ci,k} (actor/critic adaptation gains) = 13, 15
    Hand-set in Section IV; constrained only by φ_u > 1/2 and φ_u > φ_c > φ_u/2.
  • δ_{i,k}, σ_{i,k} (identifier adaptation/leakage gains) = 1.5, 1.5
    Hand-set in Section IV; no learning-rate tuning rule given.
  • Hybrid ETC thresholds H_g, ϱ_i, ϱ̄_i, Υ_i, λ_i, λ̄_i, λ*_i = 6, 0.28, 3, 0.3, 5.2, 3, 3.2
    Hand-set in Section IV; these directly determine the trigger counts in Table I (86.53%, 81.20%, 79.80%) and the Zeno-free bound t* ≥ max{...}/Λ.
  • K_u weights α, β, γ = 0.3, 0.6, 0.1
    Hand-set in Section IV; the reported K_u convergence to the [0.9, 1.1] band in Fig. 6 is a consequence of this choice.
  • RBF basis parameters (number of neurons, centers, widths) = unspecified
    Eq. (11) invokes RBF approximation J⁰ = W*^T Q + ρ and h* = W*^T Q + ρ, but the networks are never specified; the identifier's approximation quality and the residual bounds ρ depend on this missing choice.
assumptions (8)
  • domain assumption Assumption 1: y_r(t) and ẏ_r(t) are bounded and known
    Section II-B; standard for tracking; bounds the reference and its derivative.
  • domain assumption Assumption 2: there exists unknown nonnegative Φ_i with |h_{i,n} + c_iξ_i| ≤ Φ_i
    Section II-B; confines the fault/uncertainty magnitude; the text states 'without these assumptions the algorithm cannot be realized.'
  • standard math Lemma 1 (tanh inequality 0 ≤ |χ₁| − χ₁ tanh(χ₁/χ₂) ≤ ε*χ₂)
    Used to bound ETC terms (25)-(26).
  • standard math Lemma 2 (Lyapunov equation existence for Hurwitz A)
    Used in the weight-error matrix elimination in (28).
  • standard math Lemma 3 (comparison lemma giving SGUUB from V̇ ≤ −Ψ₁V + Ψ₂)
    Basis of the boundedness conclusion (31).
  • domain assumption RBF universal approximation holds on a compact set containing the closed-loop trajectory
    Eq. (11); the compact set where W*, ρ bounds hold is assumed while boundedness of the trajectory is exactly what Theorem 1 must prove.
  • ad hoc to paper κ_i(t) = (1+ϖ₁ϱ_i)u*_i(t) + ϖ₂λ*_i with |ϖ₁|,|ϖ₂| ≤ 1 under the hybrid ETC
    Section III-C before (25); this linear-in-u* representation is not derivable from the saturated controller (19) κ = −(1+ϱ)(u* tanh(u*z/Υ) + ϱ̄ tanh(ϱ̄z/Υ)); the stability/ETC bound (25) rests on it.
  • ad hoc to paper Δ in (29)-(30) is a constant independent of z and Ŵ
    Needed for V ≤ e^{−℘t}V(0) + Δ/℘; but (30) contains z⁶, (Ŵ^TQ)², ηz⁴, z⁴_{k+1} terms so Δ is state-dependent as written.
invented entities (1)
  • K_u composite performance index
    purpose: A single metric combining triggering cost, tracking degradation, and actuation wear, normalized against the continuous-control run (αK_trigger + βK_track + γK_control).
    Defined in Section IV; the weights (0.3, 0.6, 0.1) are hand-set and the index is evaluated on the same single simulation used to validate the controller, so it cannot provide independent evidence for the control claims; it is a presentation layer, not a predictive quantity.

how reviews work

0 comments
Cite this review

Pith. "Pith review of On Optimal Event-Triggered Distributed Control for Stochastic Multi-Agent Systems via Reinforcement Learning." pith.science (2026). https://pith.science/paper/MZSGEHXD

@misc{pith2026260717635,
  author       = {Pith},
  title        = {Pith review of: On Optimal Event-Triggered Distributed Control for Stochastic Multi-Agent Systems via Reinforcement Learning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MZSGEHXD}},
  note         = {Machine review of arXiv:2607.17635}
}
read the original abstract

We propose a reinforcement learning (RL) based optimal distributed control algorithm for the multi-agent systems (MASs) with stochastic uncertainties. Unlike existing methods, during the optimized backstepping design process, we use the actor-critic-identifier structure. The actor neural network is used to reflect control behavior, the critic neural network works to evaluate control performance and the unknown stochastic uncertainties are handled by identifier neural network. Furthermore, a low-pass filter effectively suppresses problems stemming from non-affine nonlinear faults and a hybrid event-triggered control (ETC) strategy is proposed to reduce control frequency. We analyze our algorithm's operation, and we provide a Lyapunov-based stability proof that guarantees all errors are bounded, ensuring precise tracking between the leader and followers. We validate its correctness in a single-axis robotic manipulator simulation and finally, we compare against the non-optimal control algorithm highlighting our optimal control algorithm's operational advantages.

Figures

Figures reproduced from arXiv: 2607.17635 by the authors.

Figure 1
Figure 1. Communication topology [PITH_FULL_IMAGE:figures/full_fig_p007_1.png] view at source ↗
Figure 4
Figure 4. The control signal of followers under the hybrid ETC [PITH_FULL_IMAGE:figures/full_fig_p007_4.png] view at source ↗
Figure 2
Figure 2. The tracking performance under the RL-based optimal [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗
Figures from the paper (4 more)
Figure 5
Figure 5. Figure 5: The intervals of the hybrid ETC strategy for followers. [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 3
Figure 3. Figure 3: The weight norms of the actor, critic, identifier NNs [PITH_FULL_IMAGE:figures/full_fig_p007_3.png]
Figure 6
Figure 6. Figure 6: The value of Ku for each follower in the control process. while preserving tracking accuracy and control effort at levels comparable to the continuous-control benchmark. In this paper, the weight parameters for the proposed analytical framework are set as α = 0.3, β = …
Figure 7
Figure 7. Figure 7: Comparison of tracking performance between the [PITH_FULL_IMAGE:figures/full_fig_p009_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

45 extracted references · 2 linked inside Pith

  1. [1]

    Resilient event-triggered containment control of multiagent systems under asynchronous DoS attacks and disturbances,

    M. Mousavian and H. Atrianfar, “Resilient event-triggered containment control of multiagent systems under asynchronous DoS attacks and disturbances,”IEEE Trans. Control Netw. Syst., vol. 12, no. 1, pp. 85-95, 2024

  2. [2]

    Survey of distributed algorithms for resource allocation over multi-agent systems,

    M. Doostmohammadian, A. Aghasi, M. Pirani, E. Nekouei, H. Zarrabi, R. Keypour, A. I. Rikos, and K. H. Johansson, “Survey of distributed algorithms for resource allocation over multi-agent systems,”Annu. Rev. Control, vol. 59, pp. 100983, 2025

  3. [3]

    Data-driven output consensus tracking control for heterogeneous multiagent systems with a dynamic leader,

    Y . Zhou, G. Wen, J. Zhou, H. Liu, and J. L ¨u, “Data-driven output consensus tracking control for heterogeneous multiagent systems with a dynamic leader,”IEEE Trans. Control Netw. Syst., vol. 12, no. 3, pp. 2029-2039, 2025

  4. [4]

    Distributed event-triggered algorithms for finite-time privacy-preserving quantized average consensus,

    A. I. Rikos, T. Charalambous, K. H. Johansson, and C. N. Hadjicostis, “Distributed event-triggered algorithms for finite-time privacy-preserving quantized average consensus,”IEEE Trans. Control Netw. Syst., vol. 10, no. 1, pp. 38-50, 2022

  5. [5]

    Survey of distributed algorithms for resource allocation over multi-agent sys- tems,

    Tao Yang, Xinlei Yi, Junfeng Wu, Ye Yuan, Di Wu, Ziyang Meng, Yiguang Hong, Hong Wang, Zongli Lin, and Karl H. Johansson, “Survey of distributed algorithms for resource allocation over multi-agent sys- tems,”Annu. Rev. Control, vol. 59, pp. 100983, 2025. 10

  6. [6]

    Distributed coor- dination control for multi-robot networks using Lyapunov-like barrier functions,

    D. Panagou, D. M. Stipanovi ´c, and P. G. V oulgaris, “Distributed coor- dination control for multi-robot networks using Lyapunov-like barrier functions,”IEEE Trans. Autom. Control, vol. 61, no. 3, pp. 617-632, 2015

  7. [7]

    Distributed event-triggered optimal control method for heterogeneous energy storage systems in smart grid,

    W. Kang, M. Chen, Y . Guan, L. Tang, and J. M. Guerrero, “Distributed event-triggered optimal control method for heterogeneous energy storage systems in smart grid,”IEEE Trans. Sustain. Energy, vol. 13, no. 4, pp. 1944-1956, 2022

  8. [8]

    Adaptive event-triggered formation control of autonomous vehicles,

    Z. Wang, Y . Zhang, C. Zhao, and H. Yu, “Adaptive event-triggered formation control of autonomous vehicles,” 2025, arXiv preprint arXiv:2506.06746

Show all 45 references
  1. [9]

    Distributed intermittent fault detection for linear stochastic systems over sensor network,

    Y . Niu, L. Sheng, M. Gao, and D. Zhou, “Distributed intermittent fault detection for linear stochastic systems over sensor network,”IEEE Trans. Cybern., vol. 52, no. 9, pp. 9208-9218, 2021

  2. [10]

    Adaptive leaderless consensus control of strict-feedback nonlinear multiagent systems with unknown control directions,

    H. Rezaee and F. Abdollahi, “Adaptive leaderless consensus control of strict-feedback nonlinear multiagent systems with unknown control directions,”IEEE Trans. Syst. Man Cybern. Syst., vol. 51, no. 10, pp. 6435-6444, 2020

  3. [11]

    Mean-nonovershooting control of stochastic nonlinear systems,

    W. Li and M. Krstic, “Mean-nonovershooting control of stochastic nonlinear systems,”IEEE Trans. Autom. Control, vol. 66, no. 12, pp. 5756-5771, 2020

  4. [12]

    Distributed adaptive asymptotic consensus tracking control for stochastic nonlinear MASs with unknown control gains and output constraints,

    Y . Zhu, B. Niu, Z. Shang, Z. Wang, and H. Wang, “Distributed adaptive asymptotic consensus tracking control for stochastic nonlinear MASs with unknown control gains and output constraints,”IEEE Trans. Autom. Sci. Eng., vol. 22, pp. 328-338, 2024

  5. [13]

    Asymptotically optimal decentralized control for large population stochastic multiagent systems,

    T. Li and J. F. Zhang, “Asymptotically optimal decentralized control for large population stochastic multiagent systems,”IEEE Trans. Autom. Control, vol. 53, no. 7, pp. 1643-1660, 2008

  6. [14]

    Stochastic consensus control of second-order nonlinear multiagent systems with external disturbances,

    H. Ji, H. T. Zhang, Z. Ye, H. Zhang, B. Xu, and G. Chen, “Stochastic consensus control of second-order nonlinear multiagent systems with external disturbances,”IEEE Trans. Control Netw. Syst., vol. 5, no. 4, pp. 1585-1596, 2017

  7. [15]

    Distributed control of nonlinear stochastic multi-agent systems with external disturbance and time-delay via event- triggered strategy,

    K. Sun, H. Yu, and X. Xia, “Distributed control of nonlinear stochastic multi-agent systems with external disturbance and time-delay via event- triggered strategy,”Neurocomputing, vol. 452, pp. 275-283, 2021

  8. [16]

    Distributed stochastic model predictive control for heterogeneous UA V swarm,

    M. Lin, B. Li, B. Zhou, and C. Cecati, “Distributed stochastic model predictive control for heterogeneous UA V swarm,”IEEE Trans. Ind. Electron., vol. 72, no. 7, pp. 7384-7394, 2024

  9. [17]

    Event-triggered V2X communication and control co-design for intelligent electrified transportation systems,

    Z. Wang, X. Ge and Q.-L. Han, “Event-triggered V2X communication and control co-design for intelligent electrified transportation systems,”J. Intell. Connect. Veh., early accepted. DOI: 10.26599/JICV .2026.9210088

  10. [18]

    Dynamic programming,

    R. Bellman, “Dynamic programming,”Science, vol. 153, no. 3731, pp. 34-37, 1966

  11. [19]

    Generalized risk-sensitive optimal control and Hamil- ton–Jacobi–Bellman equation,

    J. Moon, “Generalized risk-sensitive optimal control and Hamil- ton–Jacobi–Bellman equation,”IEEE Trans. Autom. Control, vol. 66, no. 5, pp. 2319-2325, 2020

  12. [20]

    Abstractions of Hamiltonian control systems,

    P. Tabuada and G. J. Pappas, “Abstractions of Hamiltonian control systems,”Automatica, vol. 39, no. 12, pp. 2025-2033, 2003

  13. [21]

    Safe learning in robotics: From learning-based control to safe reinforcement learning,

    L. Brunke, M. Greeff, A. W. Hall, Z. Yuan, S. Zhou, J. Panerati, and A. P. Schoellig, “Safe learning in robotics: From learning-based control to safe reinforcement learning,”Annu. Rev. Control Robot. Auton. Syst., vol. 5, no. 1, pp. 411-444, 2022

  14. [22]

    Looking back on the actor–critic architecture,

    A. G. Barto, R. S. Sutton, and C. W. Anderson, “Looking back on the actor–critic architecture,”IEEE Trans. Syst. Man Cybern. Syst., vol. 51, no. 1, pp. 40-50, 2020

  15. [23]

    Adaptive optimal control of unknown constrained-input systems using policy iteration and neural networks,

    H. Modares, F. L. Lewis, and M. B. Naghibi-Sistani, “Adaptive optimal control of unknown constrained-input systems using policy iteration and neural networks,”IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 10, pp. 1513-1525, 2013

  16. [24]

    Neuronlike adaptive elements that can solve difficult learning control problems,

    A. G. Barto, R. S. Sutton, and C. W. Anderson, “Neuronlike adaptive elements that can solve difficult learning control problems,”IEEE Trans. Syst. Man Cybern., no. 5, pp. 834-846, 2012

  17. [25]

    Actor–critic-based optimal tracking for partially unknown nonlinear discrete-time systems,

    B. Kiumarsi and F. L. Lewis, “Actor–critic-based optimal tracking for partially unknown nonlinear discrete-time systems,”IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 1, pp. 140-151, 2014

  18. [26]

    A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems,

    S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, and W. E. Dixon, “A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems,”Automatica, vol. 49, no. 1, pp. 82-92, 2013

  19. [27]

    Simplified optimized backstepping control for a class of nonlinear strict-feedback systems with unknown dynamic functions,

    G. Wen, C. P. Chen, and S. S. Ge, “Simplified optimized backstepping control for a class of nonlinear strict-feedback systems with unknown dynamic functions,”IEEE Trans. Cybern., vol. 51, no. 9, pp. 4567-4580, 2020

  20. [28]

    Optimized leader-follower consensus control of multi-QUA V attitude system using reinforcement learning and backstepping,

    G. Wen, Y . Song, Z. Li, and B. Li, “Optimized leader-follower consensus control of multi-QUA V attitude system using reinforcement learning and backstepping,”IEEE Trans. Emerg. Top. Comput. Intell., vol. 9, no. 2, pp. 1469-1479, 2025

  21. [29]

    Krstic, I

    M. Krstic, I. Kanellakopoulos, and P. V . Kokotovic,Nonlinear and Adaptive Control Design. New York, NY , USA: Wiley, 1995

  22. [30]

    Observer-based event-triggered adaptive control for nonlinear multiagent systems with unknown states and disturbances,

    N. Pang, X. Wang, and Z. Wang, “Observer-based event-triggered adaptive control for nonlinear multiagent systems with unknown states and disturbances,”IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 9, pp. 6663-6669, 2021

  23. [31]

    Optimal control of linear systems with limited control actions: Threshold-based event-triggered control,

    B. Demirel, E. Ghadimi, D. E. Quevedo, and M. Johansson, “Optimal control of linear systems with limited control actions: Threshold-based event-triggered control,”IEEE Trans. Control Netw. Syst., vol. 5, no. 3, pp. 1275-1286, 2017

  24. [32]

    Adaptive neural self- triggered bipartite fault-tolerant control for nonlinear MASs with dead- zone constraints,

    F. Cheng, H. Liang, H. Wang, G. Zong, and N. Xu, “Adaptive neural self- triggered bipartite fault-tolerant control for nonlinear MASs with dead- zone constraints,”IEEE Trans. Autom. Sci. Eng., vol. 20, no. 3, pp. 1663- 1674, 2022

  25. [33]

    Event-triggered adaptive control for a class of uncertain nonlinear systems,

    L. T. Xing, C. Y . Wen, Z. T. Liu, H. Y . Su, and J. P. Cai, “Event-triggered adaptive control for a class of uncertain nonlinear systems,”IEEE Trans. Automat. Control, vol. 62, no. 4, pp. 2071-2076, 2017

  26. [34]

    Adaptive fixed-time control for full state-constrained nonlinear systems: switched-self-triggered case

    Z. Wang, X. Wang and N. Pang, “Adaptive fixed-time control for full state-constrained nonlinear systems: switched-self-triggered case”IEEE Trans. Circuits Syst. II Express Briefs, vol. 71, no. 2, pp. 752-756, 2024

  27. [35]

    Fuzzy observed-based adaptive consensus tracking control for second-order multiagent systems with heterogeneous nonlinear dynamics,

    C. P. Chen, C. E. Ren, and T. Du, “Fuzzy observed-based adaptive consensus tracking control for second-order multiagent systems with heterogeneous nonlinear dynamics,”IEEE Trans. Fuzzy Syst., vol. 24, no. 4, pp. 906-915, 2015

  28. [36]

    Observer-based event- triggered optimal control for nonlinear multiagent systems with input delay via reinforcement learning strategy,

    X. Wang, Y . Liao, L. Tan, W. Zhang, and H. Li, “Observer-based event- triggered optimal control for nonlinear multiagent systems with input delay via reinforcement learning strategy,”IEEE Trans. Emerg. Topics Comput. Intell., vol. 9, no. 3, pp. 2398-2409, 2025

  29. [37]

    Fixed-relative- switched threshold strategies for consensus tracking control of nonlinear multiagent systems,

    Z. Wang, Y . Gao, A. I. Rikos, N. Pang, and Y . Ji, “Fixed-relative- switched threshold strategies for consensus tracking control of nonlinear multiagent systems,”2025 IEEE 19th Int. Conf. Control Autom. (ICCA), pp. 899-905, 2025

  30. [38]

    Fuzzy adaptive finite-time fault- tolerant control for strict-feedback nonlinear systems,

    K. Sun, L. Liu, J. Qiu, and G. Feng, “Fuzzy adaptive finite-time fault- tolerant control for strict-feedback nonlinear systems,”IEEE Trans. Fuzzy Syst., vol. 29, no. 4, pp. 786-796, 2021

  31. [39]

    Adaptive neural net- work finite-time output feedback control of quantized nonlinear systems,

    F. Wang, B. Chen, C. Lin, J. Zhang, and X. Meng, “Adaptive neural net- work finite-time output feedback control of quantized nonlinear systems,” IEEE Trans. Cybern., vol. 48, no. 6, pp. 1839-1848, 2017

  32. [40]

    Event-triggered adaptive preassigned finite-time consensus control for multiagent systems with nonlinear faults,

    Y . Salmanpour, M. M. Arefi, and J. Cao, “Event-triggered adaptive preassigned finite-time consensus control for multiagent systems with nonlinear faults,”IEEE Trans. Cybern., vol. 54, no. 12, pp. 7392-7403, 2024

  33. [41]

    Cooperative switched formation control of autonomous vehicles: An event-triggered approach to input saturation and time-delay challenges,

    Z. Wang, G. Jiang, Y . Zhang, K. H. Johansson and A. I. Rikos, “Cooperative switched formation control of autonomous vehicles: An event-triggered approach to input saturation and time-delay challenges,” 2026, arXiv preprint arXiv:2606.11971

  34. [42]

    Optimized leader-following con- sensus control for stochastic multiagent systems via switched-triggered input,

    L. Wang, Z. Wang, and X. Wang, “Optimized leader-following con- sensus control for stochastic multiagent systems via switched-triggered input,”J. Franklin Inst., vol. 363, no. 8, p. 108678, 2026

  35. [43]

    Supply chain planning for random demand surges: Reactive capacity and safety stock,

    L. Huang, J. S. Song, and J. Tong, “Supply chain planning for random demand surges: Reactive capacity and safety stock,”Manuf. Serv. Oper. Manag., vol. 18, no. 4, pp. 509-524, 2016

  36. [44]

    Unraveling behavioral ordering: Relative costs and the bullwhip effect,

    B. B. Moritz, A. Narayanan, and C. Parker, “Unraveling behavioral ordering: Relative costs and the bullwhip effect,”Manuf. Serv. Oper. Manag., vol. 24, no. 3, pp. 1733-1750, 2022

  37. [45]

    Budget-driven multiperiod hub location: A robust time-series approach,

    J. Hu, Z. Chen, and S. Wang, “Budget-driven multiperiod hub location: A robust time-series approach,”Oper. Res., vol. 73, no. 2, pp. 613-631, 2025

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.