REVIEW 5 major objections 3 minor 32 references
Data-Driven Nonlinear Regulation: Gaussian Process Learning
T0 review · 5 major / 3 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper shows that a Gaussian process can learn the unknown internal-model steady-state map online, yielding practical output regulation with output feedback alone.
desk verdict A plausible and novel GP-hybrid regulator architecture, but the main stability theorem is not proven: the proof conflates posterior variance with actual error and uses a high-probability GP bound deterministically. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The object that carries the argument is the Gaussian-process learned internal model: the pair $(\eta,u)$ of measured internal-model state and control input are treated as proxies for the unmeasured ideal pair $(\eta^\star,u^\star)$, and a Gaussian process with squared exponential kernel is trained online to approximate the steady-state map $u^\star = \varpi(\eta^\star)$. The hybrid clock with period $T$ splits the dynamics into continuous flow (where the Gaussian process prediction is held fixed) and discrete jumps (where the dataset is updated with a sliding window), which keeps the training cost bounded. The stability proof rests on the Gaussian process posterior variance monotone decrease in (34), the uniform error bound of Lemma 1, and a high-gain feedback term $k_p\rho(e)e$ that renders the Lyapunov derivative negative on the flow set.
What would settle it
Run the regulator on a plant whose ideal feedforward $u^\star$ is identically zero but whose initial error is large, with $k_p$ chosen so that $-k_p\rho(e)e$ dominates the recorded input during the first sliding window; if after the first Gaussian process update the learned map $\mu(\eta)$ produces predictions far from zero that are not corrected by subsequent updates, then the proxying assumption is violated and the regulation error will not converge to the predicted $\varepsilon_\mu$.
Extended reading notes
Core claim
The paper's central claim is that practical output regulation for the nonlinear system (1)–(3) can be achieved with only measurements of the regulated output, by learning the unknown continuous map $\varpi(\eta^\star)$ that produces the ideal feedforward control $u^\star$ from the internal model state $\eta^\star$. The regulator (18)–(19) interconnects a linear internal model $\dot{\eta} = M\eta + N u$ with a Gaussian process approximation $\hat{u} = \mu(\eta)$, updated at discrete jumps of a hybrid clock, plus a high-gain term $-k_p\rho(e)e$ that stabilizes the augmented system. Theorem 1 asserts that every solution from the compact set $\mathcal{A}$ is bounded for all $(t,j)$ and satisfies $|\phi(t,j)|_{\mathcal{A}} \le \varepsilon_\mu$ as $(t,j) \to \infty \times \infty$, where $\varepsilon_\mu$ is the Gaussian process approximation error measured through the uniform bound of Lemma 1. The proof shows the Lyapunov function $V = \exp(T-\tau)(V_1 + e^2 + (\hat{u}-u^\star)^2)$ decreases along flows when the high gain dominates, and does not increase at jumps because the Gaussian process posterior variance $\sigma^2_{n+1}(\eta) \le \sigma^2_n(\eta)$, so the learned model improves (or at least does not worsen) with each update.
Load-bearing premise
The training loop assumes that the measured internal model state $\eta$ and the applied control $u$ are close enough to the ideal signals $\eta^\star$ and $u^\star$ that learning on them yields the correct map; if the high-gain feedback term dominates the recorded $u$, the Gaussian process learns a biased relationship and the decomposition in equation (28) that the stability proof relies on no longer holds.
Editorial extensions
If this is right
- Output regulation becomes a supervised learning problem: the controller's internal model is a nonparametric function estimated from input-output data, so no explicit solution of the regulator equations is needed.
- Since the Gaussian process model is updated only at discrete jump instants, the online computational cost is bounded by the sliding window size $P$, avoiding the $O(R^3)$ training cost blow-up of a growing dataset.
- The regulator works from output measurements alone, so it applies to plants with modelling errors and parameter uncertainties without any observer design.
- The regulation error bound $\varepsilon_\mu$ is directly tied to the Gaussian process prediction error, which shrinks as informative data accumulate, so the accuracy of regulation improves automatically with continued learning.
- The hybrid formulation decouples learning from control: the predictor is fixed during flow and refreshed at jumps, simplifying the numerical implementation compared to continuous-time identifiers that need the time derivative of the learned model.
Reading between the lines
- A direct extension would be to multi-input plants by using vector-valued Gaussian processes for the map $\varpi$, but the paper's Lyapunov analysis is developed for scalar control; the vector case would require a matrix-valued posterior variance monotonicity argument.
- The sliding window introduces a forgetting mechanism: if the operating regime changes, old data are discarded, which may trade asymptotic accuracy for adaptivity; the paper does not quantify how the window size $P$ affects the achievable $\varepsilon_\mu$.
- Because the high-gain term dominates the recorded control during transients, an active-data-selection policy (e.g., collecting training samples only near steady state) could accelerate learning and reduce the bias flagged in the weakest-assumption note; this is a testable modification.
- The same Gaussian-process internal-model idea could be coupled with exploration in the input to guarantee the training data cover the relevant region of the internal-model state space, which the current closed-loop data collection does not explicitly ensure.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper studies approximate output regulation for a class of nonlinear systems with an output-feedback regulator that learns the steady-state internal-model map online using Gaussian process regression. The controller is formulated as a hybrid system: continuous-time flow with a high-gain feedback term plus a saturated GP posterior mean, and discrete-time jumps at which the GP is retrained on a sliding window of measured internal-model states and control inputs. The main result, Theorem 1, claims under Assumptions 1-5 that all closed-loop solutions are bounded and converge to a set of radius epsilon_mu, which shrinks as the GP model improves. The proof uses the Lyapunov function V=exp(T-tau)(V1+e^2+(hat u-u*)^2), a flow analysis based on a GP uniform error bound from the literature, and a jump analysis based on posterior-variance decrease. Three numerical examples are provided: a Lorenz-type system, a system with a nonlinear exosystem, and a continuous fermenter.
Significance. If the main theorem were correct, the paper would make a useful contribution to data-driven output regulation: it removes the polynomial steady-state generator assumption, avoids the model-based observer and the time-derivative computations required by earlier GP regulators, and proposes a hybrid implementation with a sliding window that keeps the computation manageable. The three numerical examples, especially the bioreactor, illustrate the intended application domain. The flow part of the Lyapunov argument follows standard tools, and the use of a literature GP error bound is appropriate in spirit. However, the central stability proof contains several load-bearing gaps, discussed below, so the claimed result is not established as written. The significance of the paper is therefore conditional on a substantially reworked proof.
major comments (5)
- [Section IV, Eq. (31)] At a jump, tau=T, so V(chi)=exp(T-tau)(V1+e^2+(mu_n(eta)-u*)^2) equals V1+e^2+(mu_n(eta)-u*)^2, not exp(T)(V1+e^2+(mu_n(eta)-u*)^2) as written in Eq. (31). After the reset tau+=0, the jump difference V(g(chi))-V(chi) contains the additional positive term (exp(T)-1)(V1+e^2). The proof ignores this term, so the jump nonincrease condition (35) does not follow even if the GP error decreases. This is a load-bearing algebraic error in the hybrid Lyapunov argument.
- [Section IV, Eqs. (29)-(30)] Lemma 1 is a high-probability statement: the bound |mu(eta*)-varpi(eta*)| <= sqrt(beta) sigma + gamma holds with probability at least 1-delta, with beta depending on delta and on the data. The proof treats C_mu as a deterministic constant for all time and all data updates; no union bound over the countably many jump updates or over the continuous trajectory is supplied. Moreover, C_mu contains L_mu||zeta||^2, where zeta = bar_eta + b^{-1} N e is state-dependent, so the step from (29) to the constant epsilon_mu in (30) is not justified. Without a uniform high-probability event and a smallness condition on L_mu, the ultimate boundedness claim is unsupported.
- [Section IV, Eq. (33)] The posterior variance sigma^2(eta) is the posterior expectation of the squared prediction error, not the realized squared error (mu(eta)-u*)^2 for the particular sample varpi. Substituting the posterior variance for the generalization error epsilon_D as defined in Eq. (17) is therefore not an equality, and a decrease in posterior variance does not imply that (mu_{n+1}(eta)-u*)^2 <= (mu_n(eta)-u*)^2 along the realized trajectory. The jump nonincrease condition (35) relies on this substitution, so the jump part of the proof is not valid as written.
- [Section III-C and Theorem 1] The training pairs are the measured internal-model state eta and the measured control u, but the proof requires that mu(eta) approximate the ideal map varpi(eta*). The measured control u includes the high-gain feedback term -kp rho(e)e and the saturation function, and during the initial cycle it is purely feedback. No assumption among Assumptions 1-5 formalizes the statement in Section III-C that eta and u 'can serve as suitable proxies' for eta* and u*. Without such a uniform approximation assumption, the learned GP map is biased, and the decomposition eta = eta* + zeta used in Eq. (28) does not supply the needed bound on mu(eta)-varpi(eta*). This is load-bearing for the regulation error estimate.
- [Section IV, Theorem 1] The set A := {0,T} x R^{nz} x R^{n_eta} x E x Theta is not compact because the Euclidean factors R^{nz} and R^{n_eta} are unbounded. As stated, A contains every z and eta component, so the distance |phi(t,j)|_A is trivially zero in those coordinates and the claimed boundedness and convergence to A are vacuous in those components. The theorem should quantify over a compact subset of the state space or define A differently.
minor comments (3)
- [Section IV, Eqs. (24)-(25)] The same symbol alpha_{1z} is used for both the lower and upper bounding functions in (25a) and (25b), and the overbar on the constant c0 appears to be lost in (24). This makes the K-infinity estimates ambiguous and should be corrected.
- [Section IV, Eq. (26)] The saturation level M = max(mu(eta)) is not defined over a set; the boundedness of mu on the relevant compact domain should be stated explicitly before saturation is introduced.
- [Throughout] There are several typographical errors, including 'contant' for 'constant' in Assumption 1, a stray 'a' in the parameter description of Example V-A, and 'an locally pre-attractive' in Definition 3. Reference [20] appears to misspell 'Goebel' as 'Goedel'. These should be corrected in revision.
Circularity Check
No significant circularity: the GP error bound is imported from an external lemma and the stability proof is not a reparameterization of the fitted model.
full rationale
The claimed derivation is not circular. Theorem 1's stability proof uses a Lyapunov function and imports the Gaussian-process error bound directly from Lemma 1 (an external high-probability bound from [26]), rather than fitting C_mu to the data or defining C_mu to be the regulation error. The flow inequality (29)-(30) is obtained by standard dissipativity and Young's inequality manipulations, and the ultimate ball radius epsilon_mu = alpha_1^{-1}(b_* C_mu exp(T)) is computed from that inequality rather than assumed. The jump analysis invokes the known posterior-variance-decrease property of GP conditioning; even if the substitution in Eq. (33) is mathematically questionable (posterior variance is the expected, not realized, generalization error), that is a correctness gap, not a circular reduction. Minor self-citations ([14], [23]) are motivational and do not carry the load of the theorem. Therefore the paper is self-contained with respect to circularity concerns.
Assumptions & free parameters
free parameters (4)
- GP kernel hyperparameters (σ_f^2, ℓ_i) =
not reported; obtained by maximum likelihood
- Sliding window size P =
10 (all examples)
- Hybrid update period T =
0.1 (Example 1)
- Control gain k_p and shaping function ρ(e) =
k_p = 500/700 (Example 1), 300 (Example 2), 30 (Example 3); ρ(e) = e^2 + 1
assumptions (8)
- domain assumption Assumption 1: b(w,σ) is continuous, positive, and lower bounded by b⋆
- domain assumption Assumption 2: regulator equations are solvable; z⋆(w,σ) exists
- ad hoc to paper Assumption 3: ϖ(η⋆) is a sample from a zero-mean Gaussian process with kernel K
- domain assumption Assumption 4: ϖ has bounded norm in the RKHS of K
- standard math Assumption 5: kernel K is smooth and Lipschitz
- domain assumption The internal model (7) with controllable (M,N), M Hurwitz, n_η = 2(n_w+n_z+1) exists
- ad hoc to paper Measured (η,u) are suitable proxies for unmeasured (η⋆,u⋆)
- domain assumption The z-subsystem admits an ISS Lyapunov function with the supply-rate property
Cite this review
Pith. "Pith review of Data-Driven Nonlinear Regulation: Gaussian Process Learning." pith.science (2026). https://pith.science/paper/EHUH3AEN
@misc{pith2026250609273,
author = {Pith},
title = {Pith review of: Data-Driven Nonlinear Regulation: Gaussian Process Learning},
year = {2026},
howpublished = {\url{https://pith.science/paper/EHUH3AEN}},
note = {Machine review of arXiv:2506.09273}
}
read the original abstract
This article addresses the output regulation problem for a class of nonlinear systems using a data-driven approach. An output feedback controller is proposed that integrates a traditional control component with a data-driven learning algorithm based on Gaussian Process (GP) regression to learn the nonlinear internal model. Specifically, a data-driven technique is employed to directly approximate the unknown internal model steady-state map from observed input-output data online. Our method does not rely on model-based observers utilized in previous studies, making it robust and suitable for systems with modelling errors and model uncertainties. Finally, we demonstrate through numerical examples and detailed stability analysis that, under suitable conditions, the closed-loop system remains bounded and converges to a compact set, with the size of this set decreasing as the accuracy of the data-driven model improves over time.
Figures
Figures from the paper (6 more)
Reference graph
Works this paper leans on
-
[18]
Data-driven output regula- tion via Gaussian Processes and Luenberger internal models,
L. Gentilini, M. Bin, and L. Marconi, “Data-driven output regula- tion via Gaussian Processes and Luenberger internal models,”IFAC- PapersOnLine, vol. 56, no. 1, pp. 367–372, 2023
work page 2023
-
[1]
Reinforcement learning is direct adaptive optimal control,
R. S. Sutton, A. G. Barto, and R. J. Williams, “Reinforcement learning is direct adaptive optimal control,”IEEE Control Systems Magazine, vol. 12, no. 2, pp. 19–22, 2002
work page 2002
-
[2]
The internal model principle of control theory,
B. Francis and W. Wonham, “The internal model principle of control theory,”Automatica, vol. 12, no. 5, pp. 457–465, 1976
work page 1976
-
[3]
The linear multivariable regulator problem,
B. A. Francis, “The linear multivariable regulator problem,”SIAM Journal on Control and Optimization, vol. 15, no. 3, pp. 486–505, 1977
work page 1977
-
[4]
Limit sets, zero dynamics, and internal models in the problem of nonlinear output regulation,
C. Byrnes and A. Isidori, “Limit sets, zero dynamics, and internal models in the problem of nonlinear output regulation,”IEEE Transactions on Automatic Control, vol. 48, no. 10, pp. 1712–1723, 2003
work page 2003
-
[5]
Output stabilization via nonlinear luenberger observers,
L. Marconi, L. Praly, and A. Isidori, “Output stabilization via nonlinear luenberger observers,”SIAM Journal on Control and Optimization, vol. 45, no. 6, pp. 2277–2298, 2007
work page 2007
-
[6]
Output regulation by postprocessing internal models for a class of multivariable nonlinear systems,
M. Bin and L. Marconi, “Output regulation by postprocessing internal models for a class of multivariable nonlinear systems,”International Journal of Robust and Nonlinear Control, vol. 30, no. 3, pp. 1115–1140, 2020
work page 2020
-
[7]
On a robust nonlinear servomechanism prob- lem,
J. Huang and C.-F. Lin, “On a robust nonlinear servomechanism prob- lem,”IEEE Transactions on Automatic Control, vol. 39, no. 7, pp. 1510– 1513, 1994
work page 1994
Show all 32 references
-
[8]
Output regulation of nonlinear systems,
A. Isidori and C. Byrnes, “Output regulation of nonlinear systems,”IEEE Transactions on Automatic Control, vol. 35, no. 2, pp. 131–140, 1990
1990
-
[9]
A general framework for tackling the output regulation problem,
J. Huang and Z. Chen, “A general framework for tackling the output regulation problem,”IEEE Transactions on Automatic Control, vol. 49, no. 12, pp. 2203–2218, 2004
2004
-
[10]
Internal models in control, biology and neuroscience,
J. Huang, A. Isidori, L. Marconi, M. Mischiati, E. Sontag, and W. M. Wonham, “Internal models in control, biology and neuroscience,” in IEEE Conference on Decision and Control, pp. 5370–5390, 2018
2018
-
[11]
Approximate nonlinear regulation via identification-based adaptive internal models,
M. Bin, P. Bernard, and L. Marconi, “Approximate nonlinear regulation via identification-based adaptive internal models,”IEEE Transactions on Automatic Control, vol. 66, no. 8, pp. 3534–3549, 2021
2021
-
[12]
Grasping lightweight objects with chat-pm: a rotorwash-aware motion planning method,
L. Zhang, C. Han, Y . Zhu, Y . Dong, X. Ji, Z. Zhao, and J. Yang, “Grasping lightweight objects with chat-pm: a rotorwash-aware motion planning method,”IEEE Robotics and Automation Letters, vol. 8, no. 12, pp. 8114–8121, 2023
2023
-
[13]
About robustness of control systems embedding an internal model,
M. Bin, D. Astolfi, and L. Marconi, “About robustness of control systems embedding an internal model,”IEEE Transactions on Automatic Control, vol. 68, no. 3, pp. 1306–1320, 2023
2023
-
[14]
Nonparametric steady-state learning for robust output regulation of nonlinear output feedback systems,
S. Wang, M. Guay, and R. D. Braatz, “Nonparametric steady-state learning for robust output regulation of nonlinear output feedback systems,”arXiv preprint arXiv:2402.16170, 2024
2024 arXiv
-
[15]
Adaptive output regulation via nonlinear Luenberger observer-based internal models and continuous- time identifiers,
P. Bernard, M. Bin, and L. Marconi, “Adaptive output regulation via nonlinear Luenberger observer-based internal models and continuous- time identifiers,”Automatica, vol. 122, p. 109261, 2020
2020
-
[16]
Adaptive network traffic control with an integrated model-based and data-driven approach and a decen- tralised solution method,
Z. Su, A. H. Chow, and R. Zhong, “Adaptive network traffic control with an integrated model-based and data-driven approach and a decen- tralised solution method,”Transportation Research Part C: Emerging Technologies, vol. 128, p. 103154, 2021
2021
-
[17]
Sytab: A class of smooth-transition hybrid terrestrial/aerial bicopters,
J. Yang, Y . Zhu, L. Zhang, Y . Dong, and Y . Ding, “Sytab: A class of smooth-transition hybrid terrestrial/aerial bicopters,”IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9199–9206, 2022
2022
-
[19]
Huang,Nonlinear Output Regulation
J. Huang,Nonlinear Output Regulation. Philadelphia: Society for Industrial and Applied Mathematics, 2004
2004
-
[20]
Goedel, R
R. Goedel, R. G. Sanfelice, and A. R. Teel,Hybrid Dynamical Systems: Modeling Stability, and Robustness. Princeton, NJ: Princeton University Press, 2012
2012
-
[21]
Uniform practical nonlinear output regula- tion,
L. Marconi and L. Praly, “Uniform practical nonlinear output regula- tion,”IEEE Transactions on Automatic Control, vol. 53, no. 5, pp. 1184– 1202, 2008. 13
2008
-
[22]
Nonlinear observers for autonomous lipschitz continuous systems,
G. Kreisselmeier and R. Engel, “Nonlinear observers for autonomous lipschitz continuous systems,”IEEE Transactions on Automatic Control, vol. 48, pp. 451–464, March 2003
2003
-
[23]
A nonparametric learning framework for nonlinear robust output regulation,
S. Wang, M. Guay, Z. Chen, and R. D. Braatz, “A nonparametric learning framework for nonlinear robust output regulation,”IEEE Transactions on Automatic Control, vol. 70, no. 4, pp. 2134–2149, 2025
2025
-
[24]
C. E. Rasmussen and C. K. Williams,Gaussian Processes for Machine Learning. Cambridge, Massachusetts: MIT Press, 2006
2006
-
[25]
Vivarelli,Studies on the Generalisation of Gaussian Processes and Bayesian Neural Networks
F. Vivarelli,Studies on the Generalisation of Gaussian Processes and Bayesian Neural Networks. PhD thesis, Aston University, Birmingham, England, 1998
1998
-
[26]
Uniform error bounds for gaussian process regression with application to safe control,
A. Lederer, J. Umlauft, and S. Hirche, “Uniform error bounds for gaussian process regression with application to safe control,”Advances in Neural Information Processing Systems, vol. 32, pp. 659–669, 2019
2019
-
[27]
Adaptive nonlinear regulation via gaussian processes,
L. Gentilini, M. Bin, and L. Marconi, “Adaptive nonlinear regulation via gaussian processes,” inIEEE 61st Conference on Decision and Control, pp. 2532–2537, 2022
2022
-
[28]
Extremum-seeking regulator for a class of nonlinear systems with unknown control direction,
S. Wang, M. Guay, and R. D. Braatz, “Extremum-seeking regulator for a class of nonlinear systems with unknown control direction,”IEEE Transactions on Automatic Control, no. 12, pp. 8931–8937, 2024
2024
-
[29]
Chen and J
Z. Chen and J. Huang,Stabilization and Regulation of Nonlinear Systems. Cham, Switzerland: Springer, 2015
2015
-
[30]
Global robust output regulation of lower triangular systems with unknown control direction,
L. Liu and J. Huang, “Global robust output regulation of lower triangular systems with unknown control direction,”Automatica, vol. 44, no. 5, pp. 1278–1284, 2008
2008
-
[31]
Nonlinear control strategies for continuous fermenters,
M. A. Henson and D. E. Seborg, “Nonlinear control strategies for continuous fermenters,”Chemical Engineering Science, vol. 47, no. 4, pp. 821–835, 1992
1992
-
[32]
Changing supply functions in input/state stable systems,
E. Sontag and A. Teel, “Changing supply functions in input/state stable systems,”IEEE Transactions on Automatic Control, vol. 40, no. 8, pp. 1476–1478, 1995. Telema Harryreceived his B.Tech. and M.Sc. de- grees in Chemical Engineering and Chemical Pro- cess Engineering from Ri...
1995
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.