REVIEW 8 cited by
Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Reinforcement learning combined with sim-to-real transfer offers a general framework for developing locomotion controllers for legged robots. To facilitate successful deployment in the real world, smoothing techniques, such as low-pass filters and smoothness rewards, are often employed to develop policies with smooth behaviors. However, because these techniques are non-differentiable and usually require tedious tuning of a large set of hyperparameters, they tend to require extensive manual tuning for each robotic platform. To address this challenge and establish a general technique for enforcing smooth behaviors, we propose a simple and effective method that imposes a Lipschitz constraint on a learned policy, which we refer to as Lipschitz-Constrained Policies (LCP). We show that the Lipschitz constraint can be implemented in the form of a gradient penalty, which provides a differentiable objective that can be easily incorporated with automatic differentiation frameworks. We demonstrate that LCP effectively replaces the need for smoothing rewards or low-pass filters and can be easily integrated into training frameworks for many distinct humanoid robots. We extensively evaluate LCP in both simulation and real-world humanoid robots, producing smooth and robust locomotion controllers. All simulation and deployment code, along with complete checkpoints, is available on our project page: https://lipschitz-constrained-policy.github.io.
Forward citations
Cited by 8 Pith papers
-
GMT: General Motion Tracking for Humanoid Whole-Body Control
GMT trains a single unified humanoid policy using adaptive sampling and mixture-of-experts, achieving lower tracking errors than a re-implemented ExBody2 across diverse whole-body motions.
-
HuB: Learning Extreme Humanoid Balance
HuB combines reference motion refinement, balance shaping rewards, and robustness training to enable a G1 humanoid to hold extreme single-leg poses that prior tracking methods fail to maintain.
-
TWIST: Teleoperated Whole-Body Imitation System
Human MoCap drives a Unitree G1 humanoid in real time through a single teacher-student RL+BC controller that transfers zero-shot from simulation.
-
BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholds
A two-stage RL framework with a polygonal-foot foothold reward and double critic enables a Unitree G1 humanoid to traverse sparse footholds in simulation and the real world.
-
A Unified and General Humanoid Whole-Body Controller for Versatile Locomotion
A single RL policy controls walking, jumping, and standing gaits of a humanoid with tunable foot and posture parameters, plus a separate policy for hopping, and supports real-time upper-body intervention for loco-mani...
-
Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking
Mimicking-Bench provides six humanoid-scene interaction tasks with 23K human motion references and a retarget-track-imitate pipeline that beats data-free RL on average success.
-
Learning from Massive Human Videos for Universal Humanoid Pose Control
Humanoid-X contributes 163,800 text-annotated motion clips retargeted from human videos into humanoid robot poses, and UH-1 is an autoregressive transformer that maps text instructions to humanoid actions.
-
GBC: Generalized Behavior-Cloning Framework for Whole-Body Humanoid Imitation
GBC unifies MoCap retargeting and imitation learning into one framework that trains whole-body humanoid policies across multiple robot morphologies in simulation.
Discussion (0). Continue with ORCID to comment.