A SARSA reinforcement learning agent is trained offline and deployed online to adaptively set the DeePC regularization hyperparameter, with simulations showing competitive or better tracking under Gaussian and uniform noise.
Ensemble Control for Stochastic Systems with Asymmetric Laplace Noises
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
This paper presents an adaptive ensemble control for stochastic systems subject to asymmetric noises and outliers. Asymmetric noises skew system observations, and outliers with large amplitude deteriorate the observations even further. Such disturbances induce poor system estimation and degraded stochastic system control. In this work, we model the asymmetric noises and outliers by mixed asymmetric Laplace distributions (ALDs), and propose an optimal control for stochastic systems with mixed ALD noises. Particularly, we segregate the system disturbed by mixed ALD noises into subsystems, each of which is subject to a specific ALD noise. For each subsystem, we design an iterative quantile filter (IQF) to estimate the system parameters using system observations. With the estimated parameters by IQF, we derive the certainty equivalence (CE) control law for each subsystem. Then we use the Bayesian approach to ensemble the subsystem CE controllers, with each of the controllers weighted by their posterior probability. We finalize our control law as the weighted sum of the control signals by the sub-system CE controllers. To demonstrate our approach, we conduct numerical simulations and Monte Carlo analyses. The results show improved tracking performance by our approach for skew noises and its robustness to outliers, compared with single ALD based and RLS-based control policy.
citation-role summary
citation-polarity summary
fields
math.OC 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Fine-tuning for Data-enabled Predictive Control of Noisy Systems by Reinforcement Learning
A SARSA reinforcement learning agent is trained offline and deployed online to adaptively set the DeePC regularization hyperparameter, with simulations showing competitive or better tracking under Gaussian and uniform noise.