Pith. sign in

REVIEW 5 major objections 7 minor 27 references

Contraction Actor-Critic: Contraction Metric-Guided Reinforcement Learning for Robust Path Tracking

T0 review · 5 major / 7 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Training a contraction metric alongside an actor-critic policy yields a path tracker that minimizes cumulative error and asymptotically converges to the reference, provided some contracting policy exists.

desk verdict Promising empirical RL+contraction method, but Theorem 1's proof is broken and the advertised certificate is unestablished. read the letter →

arxiv 2506.15700 v1 pith:GPAZI223 submitted 2025-05-28 cs.LG cs.AI

Minjae Cho , Hiroyasu Tsukamoto , Huy Trong Tran This is my paper
classification cs.LGcs.AI
keywords ContractiontheoryControlmetricsReinforcementlearningActor-criticPathtrackingIncrementalexponentialstabilityLearneddynamicsmodelsUncertainsystems
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Contraction actor-critic (CAC) claims to give reinforcement-learned path-tracking policies a contraction certificate: a guarantee that trajectories initialized close to a reference converge to it. The route is to train, alongside the policy, a contraction metric generator (CMG) that outputs a positive-definite Riemannian metric, then use that metric to define the reward the policy maximizes. The paper proves that if at least one contracting policy exists, the optimal policy for this reward converges asymptotically, $\lim_{t\to\infty} \|\delta x(t)\|_M^2 = 0$. In simulation, CAC has the lowest cumulative tracking error on three of four benchmarks and near-best on the fourth, and a TurtleBot3 deployment transfers the learned behavior to hardware. The contribution is a way to fold a stability certificate from contraction theory into model-free RL without solving a convex feasibility problem.

What carries the argument

The central object is the contraction metric $M(x) \succ 0$, a positive-definite Riemannian metric under which the differential Lyapunov function $V = \delta x^\top M \delta x$ decays at a prescribed rate. The contraction metric generator is a neural network trained by the loss in Equation (9) to output a distribution over such metrics whose samples approximately satisfy the contraction and CCM conditions in Equations (3)–(5), evaluated with a learned dynamics model from Equation (8). The reward $R(x) = 1/(1 + \delta x^\top M \delta x) + \beta_\pi H(\pi_\theta(x))$ converts the metric into an RL signal, so maximizing it is equivalent to minimizing a bounded monotone function of the metric-weighted tracking error. A freeze-and-learn loop alternates CMG updates with $n$ policy updates, and the load-bearing estimate is the geometric-series bound of Lemma 1: $\|\delta x(t_k)\|_M^2 \le \|\delta x(t_0)\|_M^2 e^{-2\lambda k \Delta t}$ under a contracting policy.

What would settle it

Run CAC on a linear system whose optimal LQR controller is provably contracting, then measure the closed-loop squared metric distance $\|\delta x(t)\|_M^2$ along a reference over many initial offsets. If the trained policy's error does not decay exponentially at a positive rate for all tested references, the theorem's conclusion is not realized by the implemented algorithm.

Watch

Extended reading notes

Core claim

The central claim is that simultaneously learning a CMG and an actor-critic policy yields a policy that minimizes cumulative tracking error while inheriting a contraction certificate. Formally, Theorem 1 states that under Assumption 1, which postulates at least one contracting policy $\pi_c$ with rate $\lambda > 0$, the optimal policy $\pi^*$ obtained by maximizing the discounted reward $\tilde{R}(x) = 1/(1 + \|\delta x\|_M^2)$ satisfies $\lim_{t\to\infty} \|\delta x(t)\|_M^2 = 0$ for every initial condition. The proof chain is: Lemma 1 bounds the assumed contracting policy's cumulative metric distance by a geometric series, Lemma 2 equates reward maximization with cost minimization, and the resulting finite discounted cost implies convergence by Cauchy's criterion. Empirically, the paper reports that CAC achieves the lowest modified area-under-the-curve tracking error on PVTOL, NeuralLander, and Quadrotor, with Car comparable to the LQR baseline, and that a simulated-trained policy tracks a reference path on a real TurtleBot3 where C3M fails and PPO diverges.

Load-bearing premise

The proof assumes that the policy that maximizes the metric-weighted reward is itself one of the contracting policies for which the exponential-decay inequality was assumed, and the paper does not prove that the optimal policy inherits contraction.

Editorial extensions

If this is right

  • End-to-end training can replace the infinite-dimensional convex feasibility search in CCM synthesis, provided the learned dynamics model is accurate enough for the CMG loss to certify contraction.
  • Policies trained this way retain the per-step cost of a neural network, so the certificate does not impose the real-time optimization overhead of LQR-based certified controllers.
  • The reward-conditioned entropy term in the CMG loss is part of the method: ablating it degrades Car and NeuralLander tracking, suggesting the alternating freeze-and-learn schedule is needed for stable co-training.
  • Because the dynamics model is used only to evaluate the CCM conditions, the policy itself can be trained model-free, which is what lets CAC transfer from simulation to a TurtleBot3 where C3M fails and PPO diverges.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the theorem's proof transfers a contraction bound from an assumed contracting policy to the optimal policy, the cleanest test of the theory is to measure the trained policy's own contraction rate under the learned metric; if that rate is non-positive, the practical gains should be attributed to reward shaping rather than to the certificate.
  • The paper defines the tracking displacement in practice as a Euclidean difference, while the theoretical argument is stated along geodesics; replacing the Euclidean term with a geodesic or neural approximation of the metric distance would align the implementation with the proven statement.
  • The freeze-and-learn alternation is a generic recipe: any certificate that can be turned into a bounded reward, such as a control barrier function for safety, could be co-trained with a policy in the same way.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 7 minor

Summary. The manuscript proposes contraction actor-critic (CAC), an actor-critic variant in which a learned contraction metric generator (CMG) provides a reward signal based on a control contraction metric. The paper claims a theoretical guarantee (Theorem 1) that if at least one contracting policy exists, then the RL-optimal policy under the CAC reward converges asymptotically to the reference trajectory. Empirically, CAC is evaluated on four simulated platforms (Car, PVTOL, NeuralLander, Quadrotor) and on a real TurtleBot3, reporting lower modified AUC than C3M, PPO, SD-LQR, and LQR in several settings.

Significance. The empirical study is substantial and the paper is transparent about its limitations, including the online-interaction requirement and the gap between theoretical guarantees and practical condition satisfaction. If the convergence theorem were established, the paper would make a useful conceptual contribution by connecting CCM certificates to long-horizon RL objectives. The real-world robot experiments and the ablation of entropy regularization are valuable. However, the formal claim rests on a proof with a sign error, an unjustified transfer of a contraction bound to the RL-optimal policy, and a missing continuity argument; these issues are load-bearing rather than cosmetic. As it stands, the manuscript is best read as an empirical heuristic paper, not as a paper with a rigorous contraction certificate.

major comments (5)
  1. [Appendix A.3, Eq. (23)] In Eq. (23), the proof applies Lemma 1's upper bound to Eπ[Σ γ^k C_k] for an arbitrary policy π, but Lemma 1's premise, Eq. (11), is stated in Assumption 1 only for the contracting policy π_c. No argument shows that the policy optimized by Eq. (14) is itself contracting or satisfies Eq. (11). The theorem's conclusion—that π* converges—is therefore imported from the assumption rather than derived; this is a circularity in the central claim.
  2. [Lemma 1, Eq. (16)] The geometric-series evaluation in Eq. (16) is wrong in sign: since e^{-2λkΔt} with λ>0 and Δt>0, the sum is 1/(1-e^{-2λΔt}), not 1/(1-e^{2λΔt}). As written, the denominator is negative and Lemma 1 asserts a negative upper bound for a nonnegative quantity, which invalidates the bound used in Eq. (23).
  3. [Appendix A.3, Eq. (25)] Eq. (24) only establishes that the infinite discounted cost sum is finite; the Cauchy convergence argument in Eq. (25) gives C_k → 0 along the sampled times t_k, and since C(x)=∥δx∥²_M/(1+∥δx∥²_M), it gives ∥δx(t_k)∥²_M → 0 along the sampling grid. To conclude lim_{t→∞}∥δx(t)∥²_M=0 in continuous time, the proof needs an additional argument (e.g., continuity of trajectories and a bound on inter-sample growth); none is provided.
  4. [Section 3.2, Eq. (9)] The CMG loss in Eq. (9) evaluates the contraction and CCM conditions using the learned dynamics model f̂_ξ, B̂_ζ, and the Limitations section acknowledges that the guarantees may not hold during training or execution. The paper does not quantify how dynamics-model error propagates to the claimed contraction certificate, so the abstract's statement that CAC provides a contraction certificate is stronger than what is actually shown.
  5. [Section 3.2 vs Section 4] Theorem 1 and Lemma 1 assume a fixed contraction metric M and reward R(x)=1/(1+δx^T M δx). In the actual algorithm, M is sampled from the CMG Mχ(x) and the CMG parameters χ are updated jointly with the policy (Algorithm 1, Eq. (9)). The objective in Eq. (14) is therefore non-stationary, and the theorem does not establish guarantees for the simultaneous-learning procedure described in the abstract.
minor comments (7)
  1. [Eq. (10) and Table 2] Replace 'scaler' with 'scalar' in Eq. (10) and Table 2.
  2. [Theorem 1] Theorem 1 states the contraction rate as α > 0, but Lemma 1 and the proof of Theorem 1 use λ; the notation should be unified.
  3. [References] References [6] and [17] duplicate the same Singh et al. paper; the duplicate should be consolidated.
  4. [Lemma 1] Lemma 1's statement uses J^{π_c}_T but its proof writes J^π_T; make the policy under which the expectation is taken explicit.
  5. [Eq. (11)] The norm in Eq. (11) is defined through a geodesic integral, while Lemma 1 applies the bound at sampled instants; clarify how the continuous-time inequality transfers to the sampled norm.
  6. [Table 1] The inference-time column does not state whether the CMG forward pass is included; specify this for reproducibility.
  7. [Section 4 vs Algorithm 1] The theorem analyzes the reward with βπ=0, while Algorithm 1 and Table 2 use βπ=1e-2; the implications for the theoretical guarantee are not discussed.

Circularity Check

1 steps flagged · score 7.0 of 10

Theorem 1's proof invokes Lemma 1 for the RL-optimal policy without establishing the contraction premise (Eq. 11) for that policy, so the advertised convergence certificate is assumed rather than derived.

  1. other [Section 4, Theorem 1 proof / Appendix A.3, Eq. (23), with Lemma 1 and Assumption 1]
    "Eπ[Σ γ^k Ck] ≤ Eπ[Σ Ck] ≤ Eπ[Σ ∥δx(tk)∥^2_M] ≤ ∥δx(t0)∥^2_M / (1 − e^{2λΔt}), where the last inequality follows from Lemma 1. Assumption 1: 'There exists at least one contracting policy πc that ... satisfies ... ∥δx(t)∥^2_M ≤ ∥δx(t0)∥^2_M e^{−2λ(t−t0)}.'"

    Lemma 1's bound is conditional on Eq. (11), which Assumption 1 postulates only for πc. Eq. (23) applies that bound to the policy π appearing in the cost/reward objective. If that π is π*, the proof is assuming the exponential-contraction inequality for π*—exactly the asymptotic-convergence conclusion of Theorem 1—so the theorem reduces to its premise. If the π in Eq. (23) is instead πc, the argument merely restates Lemma 1 and never transfers the finite-cost bound to π* via optimality; the subsequent Cauchy step then concludes convergence for a policy whose undiscounted error sum was never bounded. In either reading, the advertised certificate is assumed, not derived by the RL/CMG training.

full rationale

The only circularity that rises to the level of a load-bearing defect is in Theorem 1. Assumption 1 assumes a contracting policy πc satisfying Eq. (11). Lemma 1 then bounds J^{πc}_T using that inequality. In the proof of Theorem 1, Eq. (23) writes Eπ[Σ γ^k C_k] ≤ ... ≤ Eπ[Σ ||δx||^2_M] ≤ C/(1 − e^{2λΔt}) 'where the last inequality follows from Lemma 1.' This step silently transfers a premise that holds only for πc to the policy being optimized (π*), which is precisely the theorem's conclusion; alternatively it only re-establishes finiteness for πc and never transfers to π*. Either way the formal claim that the RL-optimal policy inherits a contraction certificate is not proved from the stated assumptions. Separately, Lemma 1's denominator 1 − e^{2λΔt} is negative for λ > 0 and Δt > 0; the correct geometric-series denominator is 1 − e^{−2λΔt}, an additional non-circular mathematical error. No self-citation is load-bearing here: refs [4, 5, 24] are background/tutorial citations by co-author Tsukamoto, but the theorem's defect is internal. The empirical comparisons (Table 1, real-robot tests) are independent evidence and could stand as heuristic claims. Score 7: the central theoretical result reduces to its own assumption; the experiments are not circular.

Assumptions & free parameters 4 free parameters · 5 assumptions · 1 invented entities

The algorithm depends on several fitted hyperparameters and on a learned dynamics model whose error is not quantified. The theoretical claim rests on an assumption (existence of a contracting policy) that duplicates the desired convergence property, and on unproven transfer of that property to the RL-optimized policy. No new physical entities are introduced; the CMG is an algorithmic construct without independent evidence.

free parameters (4)
  • Entropy scaler beta_M for CMG = 1e-2
    Table 2; tunes the reward-conditioned entropy strength in Eq. (9); chosen empirically and affects exploration of the metric space.
  • Entropy scaler beta_pi for actor = 1e-2
    Table 2; entropy weight in the reward Eq. (10); chosen empirically and shapes stochastic policy exploration.
  • CMG metric bounds = 0.1 to 10.0
    Table 2; bounds learned metric eigenvalues; chosen by hand and constrains the feasible metric set.
  • Dynamics model weights (xi, zeta) = trained, no public checkpoints
    Eq. (8); the CMG contraction conditions are evaluated on this learned model, so the certificate's validity depends on these fitted weights.
assumptions (5)
  • ad hoc to paper There exists at least one contracting policy pi_c satisfying Eq. (11) with rate lambda > 0.
    Section 4, Assumption 1. This is the theorem's premise and essentially contains the target convergence property; it is not proved or checked in the experiments.
  • domain assumption System dynamics are control-affine with smooth drift f and actuation matrix B.
    Section 2, Eq. (1). All theoretical and algorithmic components rely on this structure.
  • domain assumption The learned dynamics model accurately represents the true system so CCM inequalities (3)-(5) evaluated on it transfer to the real system.
    Sections 3.1 and 3.2. The CMG loss and reward use approximated dynamics; the Limitations section admits guarantees may not hold during execution.
  • standard math The discount factor gamma is strictly less than 1 so infinite discounted sums are finite.
    Lemma 2 and Theorem 1 use gamma in (0,1] but Eq. (20) requires finiteness; gamma=1 invalidates the separation of the sum.
  • domain assumption The null-space basis B_perp computed by SVD of the learned B has the correct rank and span.
    Section 3.1. If the learned B has the wrong rank, the CCM conditions in Eqs. (4)-(5) are computed with the wrong constraint space.
invented entities (1)
  • Learned contraction metric distribution M_chi(x), the CMG
    purpose: Generates the metric used in the reward 1/(1 + delta_x^T M delta_x) and in the CCM condition loss; couples RL optimization to the contraction certificate.
    Introduced purely as an algorithmic construct. It makes no falsifiable prediction outside the paper's own simulated and robot evaluations, and the theoretical guarantee depends on Assumption 1 rather than on properties of this generator.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Contraction Actor-Critic: Contraction Metric-Guided Reinforcement Learning for Robust Path Tracking." pith.science (2026). https://pith.science/paper/GPAZI223

@misc{pith2026250615700,
  author       = {Pith},
  title        = {Pith review of: Contraction Actor-Critic: Contraction Metric-Guided Reinforcement Learning for Robust Path Tracking},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GPAZI223}},
  note         = {Machine review of arXiv:2506.15700}
}
read the original abstract

Control contraction metrics (CCMs) provide a framework to co-synthesize a controller and a corresponding contraction metric -- a positive-definite Riemannian metric under which a closed-loop system is guaranteed to be incrementally exponentially stable. However, the synthesized controller only ensures that all the trajectories of the system converge to one single trajectory and, as such, does not impose any notion of optimality across an entire trajectory. Furthermore, constructing CCMs requires a known dynamics model and non-trivial effort in solving an infinite-dimensional convex feasibility problem, which limits its scalability to complex systems featuring high dimensionality with uncertainty. To address these issues, we propose to integrate CCMs into reinforcement learning (RL), where CCMs provide dynamics-informed feedback for learning control policies that minimize cumulative tracking error under unknown dynamics. We show that our algorithm, called contraction actor-critic (CAC), formally enhances the capability of CCMs to provide a set of contracting policies with the long-term optimality of RL in a fully automated setting. Given a pre-trained dynamics model, CAC simultaneously learns a contraction metric generator (CMG) -- which generates a contraction metric -- and uses an actor-critic algorithm to learn an optimal tracking policy guided by that metric. We demonstrate the effectiveness of our algorithm relative to established baselines through extensive empirical studies, including simulated and real-world robot experiments, and provide a theoretical rationale for incorporating contraction theory into RL.

Figures

Figures reproduced from arXiv: 2506.15700 by the authors.

Figure 1
Figure 1. We jointly train a CMG and a policy using RL, where the reward is defined by the CMG in a manner that ensures contraction. Algorithm 1 CAC: Contraction Actor-Critic Require: Data: D = {x˙ i , xi , ui} N i=0 Require: policy iterations n 1: Initialize ξ, ζ, χ, θ, and ϕ 2: /* Dynamics pre-training */ 3: for each batch d from D do 4: Update ξ, ζ with Eqn. 8 5: end for 6: /* CAC training */ 7: for each batch d from π, T … view at source ↗
Figure 2
Figure 2. We plot the the mean and 95% confidence intervals for normalized tracking error, ∥x(t) − xd(t)∥2/∥x(0) − xd(0)∥2, over time for each environment over 10 seeds. Performance metrics. [7, 8] uses the area under the curve (AUC) of the normalized tracking error as a performance metric. However, to account for varying episode lengths, we adopt a modified AUC (MAUC) metric, defined as MAUC = L T PT t=0 ∥x(t)−xd(t)∥2 ∥x(0)−… view at source ↗
Figure 3
Figure 3. Robot demonstration of our method (CAC) compared with key baseline algorithms. The robot was initialized at five different initial locations and tasked to track the reference trajectory. The normalized tracking error across the horizon can be found in Appendix D.1. that most robotic systems, such as drones and mobile robots, operate with limited computational capacity in high-dimensional environments. (4) Entropy-re… view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Our facility for real-world robot experiments. [PITH_FULL_IMAGE:figures/full_fig_p013_4.png]
Figure 5
Figure 5. Figure 5: Mean and 95% confidence intervals for the normalized tracking error over 5 seeds from [PITH_FULL_IMAGE:figures/full_fig_p014_5.png]
Figure 6
Figure 6. Figure 6: Path-tracking results for each algorithm with the same reference trajectory are depicted [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

27 extracted references · 22 canonical work pages

  1. [7]

    D. Sun, S. Jha, and C. Fan. Learning certified control using contraction metric. In conference on Robot Learning, pages 1519–1539. PMLR, 2021

    work page 2021

  2. [8]

    S. M. Richards, J.-J. Slotine, N. Azizan, and M. Pavone. Learning control-oriented dynamical structure from data. In International Conference on Machine Learning, pages 29051–29062. PMLR, 2023

    work page 2023

  3. [1]

    I. R. Manchester and J.-J. E. Slotine. Control contraction metrics: Convex and intrinsic criteria for nonlinear feedback design. IEEE Transactions on Automatic Control , 62(6):3046–3053, 2017

    work page 2017

  4. [2]

    Lohmiller and J.-J

    W. Lohmiller and J.-J. E. Slotine. On contraction analysis for non-linear sys- tems. Automatica, 34(6):683–696, 1998. ISSN 0005-1098. doi:https://doi.org/10.1016/ S0005-1098(98)00019-3. URL https://www.sciencedirect.com/science/article/ pii/S0005109898000193

    work page 1998

  5. [3]

    Davydov, S

    A. Davydov, S. Jafarpour, and F. Bullo. Non-euclidean contraction theory for robust nonlinear stability. IEEE Transactions on Automatic Control, 67(12):6667–6681, 2022

    work page 2022

  6. [4]

    Tsukamoto, S.-J

    H. Tsukamoto, S.-J. Chung, and J.-J. E. Slotine. Contraction theory for nonlinear stability analysis and learning-based control: A tutorial overview. Annual Reviews in Control, 52:135– 169, 2021

    work page 2021

  7. [5]

    Tsukamoto and S.-J

    H. Tsukamoto and S.-J. Chung. Neural contraction metrics for robust estimation and control: A convex optimization approach. IEEE Control Systems Letters, 5(1):211–216, 2020

    work page 2020

  8. [6]

    Singh, B

    S. Singh, B. Landry, A. Majumdar, J.-J. Slotine, and M. Pavone. Robust feedback motion planning via contraction theory. The International Journal of Robotics Research , 42(9):655– 688, Aug. 2023. ISSN 0278-3649, 1741-3176. doi:10.1177/02783649231186165. URL https://journals.sagepub.com/doi/10.1177/02783649231186165

    work page doi:10.1177/02783649231186165 2023

Show all 27 references
  1. [9]

    J.-J. E. Slotine. Modular stability tools for distributed computation and control. International Journal of Adaptive Control and Signal Processing, 17(6):397–416, 2003

    2003

  2. [10]

    M. L. Puterman. Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons, 2014

    2014

  3. [11]

    Konda and J

    V . Konda and J. Tsitsiklis. Actor-critic algorithms.Advances in neural information processing systems, 12, 1999

    1999

  4. [12]

    Schulman, S

    J. Schulman, S. Levine, P. Abbeel, M. Jordan, and P. Moritz. Trust region policy optimization. In International conference on machine learning, pages 1889–1897. PMLR, 2015

    2015

  5. [13]

    Schulman, F

    J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017

    2017 arXiv

  6. [14]

    Haarnoja, A

    T. Haarnoja, A. Zhou, P. Abbeel, and S. Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning, pages 1861–1870. Pmlr, 2018

    2018

  7. [15]

    R. S. Sutton, D. McAllester, S. Singh, and Y . Mansour. Policy gradient methods for rein- forcement learning with function approximation. Advances in neural information processing systems, 12, 1999

    1999

  8. [16]

    Ahmed, N

    Z. Ahmed, N. Le Roux, M. Norouzi, and D. Schuurmans. Understanding the impact of entropy on policy optimization. In International conference on machine learning , pages 151–160. PMLR, 2019. 16

    2019

  9. [17]

    Singh, B

    S. Singh, B. Landry, A. Majumdar, J.-J. Slotine, and M. Pavone. Robust feedback motion planning via contraction theory. The International Journal of Robotics Research , 42(9):655– 688, 2023

    2023

  10. [18]

    Huang, R

    S. Huang, R. F. J. Dossa, A. Raffin, A. Kanervisto, and W. Wang. The 37 implementa- tion details of proximal policy optimization. In ICLR Blog Track , 2022. URL https: //iclr-blog-track.github.io/2022/03/25/ppo-implementation-details/ . https://iclr-blog-track.github.io/2022/0...

    2022

  11. [19]

    Engstrom, A

    L. Engstrom, A. Ilyas, S. Santurkar, D. Tsipras, F. Janoos, L. Rudolph, and A. Madry. Imple- mentation matters in deep rl: A case study on ppo and trpo. In International conference on learning representations, 2019

    2019

  12. [20]

    Andrychowicz, A

    M. Andrychowicz, A. Raichuk, P. Sta ´nczyk, M. Orsini, S. Girgin, R. Marinier, L. Hussenot, M. Geist, O. Pietquin, M. Michalski, et al. What matters for on-policy deep actor-critic meth- ods? a large-scale study. In International conference on learning representations, 2021

    2021

  13. [21]

    Singh, S

    S. Singh, S. M. Richards, V . Sindhwani, J.-J. E. Slotine, and M. Pavone. Learning stabiliz- able nonlinear dynamics with contraction-based regularization. The International Journal of Robotics Research, 40(10-11):1123–1150, 2021

    2021

  14. [22]

    A. Liu, G. Shi, S.-J. Chung, A. Anandkumar, and Y . Yue. Robust regression for safe exploration in control. In Learning for Dynamics and Control, pages 608–619. PMLR, 2020

    2020

  15. [23]

    S. L. Herbert, M. Chen, S. Han, S. Bansal, J. F. Fisac, and C. J. Tomlin. Fastrack: A modular framework for fast and guaranteed safe motion planning. In 2017 IEEE 56th Annual Confer- ence on Decision and Control (CDC), pages 1517–1522. IEEE, 2017

    2017

  16. [24]

    Tsukamoto and S.-J

    H. Tsukamoto and S.-J. Chung. Learning-based robust motion planning with guaranteed stabil- ity: A contraction theory approach. IEEE Robotics and Automation Letters, 6(4):6164–6171, 2021

    2021

  17. [25]

    Singh, V

    S. Singh, V . Sindhwani, J.-J. E. Slotine, and M. Pavone. Learning Stabilizable Dynamical Systems via Control Contraction Metrics, Nov. 2018. URL http://arxiv.org/abs/1808. 00113. arXiv:1808.00113 [cs]

    2018 arXiv

  18. [26]

    V . I. Bogachev and O. G. Smolyanov.Real and functional analysis. Springer, 2020

    2020

  19. [27]

    D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014. 17

    2014 arXiv

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.