REVIEW 35 cited by
ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Humanoid robots hold the potential for unparalleled versatility in performing human-like, whole-body skills. However, achieving agile and coordinated whole-body motions remains a significant challenge due to the dynamics mismatch between simulation and the real world. Existing approaches, such as system identification (SysID) and domain randomization (DR) methods, often rely on labor-intensive parameter tuning or result in overly conservative policies that sacrifice agility. In this paper, we present ASAP (Aligning Simulation and Real-World Physics), a two-stage framework designed to tackle the dynamics mismatch and enable agile humanoid whole-body skills. In the first stage, we pre-train motion tracking policies in simulation using retargeted human motion data. In the second stage, we deploy the policies in the real world and collect real-world data to train a delta (residual) action model that compensates for the dynamics mismatch. Then, ASAP fine-tunes pre-trained policies with the delta action model integrated into the simulator to align effectively with real-world dynamics. We evaluate ASAP across three transfer scenarios: IsaacGym to IsaacSim, IsaacGym to Genesis, and IsaacGym to the real-world Unitree G1 humanoid robot. Our approach significantly improves agility and whole-body coordination across various dynamic motions, reducing tracking error compared to SysID, DR, and delta dynamics learning baselines. ASAP enables highly agile motions that were previously difficult to achieve, demonstrating the potential of delta action learning in bridging simulation and real-world dynamics. These results suggest a promising sim-to-real direction for developing more expressive and agile humanoids.
Forward citations
Cited by 35 Pith papers
-
Light-Loco-Parkour: Versatile Perceptive Whole-Body Locomotion via Multi-Skill Distillation
A single neural-network policy, trained in simulation, makes a humanoid climb, vault, and traverse uneven terrain from onboard depth and a velocity command, with no skill labels or runtime motion graphs.
-
Handroid: Bridging Dexterous Hand and Humanoid
A single 27-DoF body doubles as an anthropomorphic dexterous hand and a 0.33 m desktop humanoid, with a unified control stack for manipulation, locomotion, and embodiment switching.
-
ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation
An autoregressive diffusion model with a hybrid explicit-root/latent-body representation generates real-time, controllable 3D human motion from text and spatial constraints.
-
MOVE: Motion-Guided Few-Shot Video Object Segmentation
MOVE provides a new motion-guided few-shot video object segmentation benchmark, and the proposed DMA baseline outperforms six existing methods across all settings.
-
$\omega$-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation
A latent-predictive world-action model lets one humanoid policy coordinate locomotion and manipulation across 11 real-world household tasks, reporting 79-82% success.
-
Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills
A taxonomy of robot learning on a weights-versus-skills axis, with a five-rung self-improvement ladder whose top cell (feedback plus memory plus search) holds only a few recent systems.
-
GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking
Online co-training of a text-to-motion generator and a humanoid tracker on simulated G1 improves generator executability and zero-shot tracker coverage beyond static replay or one-way filtering.
-
Scaling Behavior Foundation Model for Humanoid Robots
A scaling recipe for humanoid behavior foundation models—global-frame motion tracking, on-policy data quantity plus reference diversity, and a transformer with hyperspherical latents—cuts global tracking error by roug...
-
Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report
A multi-source 16,074-clip quadruped motion library plus a flow-matching generalist tracker shows empirical data scaling and zero-shot unseen tracking, integrated with all-terrain locomotion and real-robot deployment.
-
Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation
Zero-shot sim-to-real RL policies on a five-finger hand achieve commandable grasp-force tracking and in-hand reorientation using dense tactile simulation, current-to-torque calibration, and actuator randomization.
-
VOFA: Visual Object Goal Pushing with Force-Adaptive Control for Humanoids
VOFA combines a high-level visuomotor policy with a low-level force-adaptive controller to let humanoids push objects up to 17 kg to arbitrary goals using only noisy onboard vision, achieving over 80% real-world success.
-
Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization
A physics-aware motion-retargeting pipeline that uses ground-reaction-force-derived heel-toe contacts produces dynamically feasible humanoid references and improves downstream imitation learning.
-
Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation
A 10,300-demonstration, 260-task multimodal humanoid manipulation dataset with baseline policy evaluations and a cloud evaluation platform.
-
A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting
A neural retargeting pipeline maps human motion to humanoid robot motion at 5000+ frames per second using a shared latent space and physics-based fine-tuning, filtering noise and producing physically feasible trajectories.
-
In-between Motion Generation Based Multi-Style Quadruped Robot Locomotion
A CVAE-based in-between motion generator creates multi-style quadruped gaits from sparse motion data, and the trained controller runs gallop, tripod, trotting, and pacing on a real robot.
-
Robot Drummer: Learning Rhythmic Skills for Humanoid Drumming
A simulated Unitree G1 humanoid learns to drum dozens of popular songs from MIDI with high F1 scores using a Rhythmic Contact Chain and temporal decomposition.
-
Learning Motion Skills with Adaptive Assistive Curriculum Force in Humanoid Robots
A2CF uses an adaptive assistive-force agent to guide humanoid robots through training, yielding faster convergence and robust policies that work without the external force.
-
GMT: General Motion Tracking for Humanoid Whole-Body Control
GMT trains a single unified humanoid policy using adaptive sampling and mixture-of-experts, achieving lower tracking errors than a re-implemented ExBody2 across diverse whole-body motions.
-
KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills
A robot control method that adaptively tightens motion-tracking reward tolerances achieves lower tracking errors on dynamic skills and transfers zero-shot to a real humanoid.
-
From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots
BumbleBee, an expert-to-generalist pipeline using autoencoder-based motion clustering and per-cluster delta action models, reports state-of-the-art whole-body control on a Unitree G1 humanoid, with success rates of 89...
-
RL from Physical Feedback: Aligning Large Motion Models with Humanoid Control
RLPF uses reinforcement learning with a physics-simulator tracking reward and an alignment verification module to fine-tune a large text-to-motion model for physically feasible humanoid motions.
-
SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending
SkillBlender pretrains reusable goal-conditioned skills and blends them with softmax per-joint weights to solve simulated humanoid loco-manipulation tasks with one or two reward terms.
-
MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrains
A two-stage reinforcement learning pipeline with a mixture of latent residual experts gives a Unitree G1 humanoid multiple commanded human-like gaits over complex terrains.
-
Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Control
A slow-fast two-agent reinforcement learning architecture with separate upper- and lower-body policies reduces end-effector shaking during humanoid locomotion.
-
ComplexMimic: Human-Scene Interaction Imitation in Complex 3D Environments
Dual-expert RL plus difficulty-aware multi-teacher distillation improves physics-based human–scene interaction imitation under complex 3D geometry versus prior single-policy baselines.
-
Tired Actor: Fatigue-Informed Character Control
Injecting a muscle-fatigue model into a general physics-based character controller preserves motion imitation accuracy while producing tired, more human-like behaviors such as shorter steps, corner cutting, and fall c...
-
A Single Diffusion-Policy Controller for Multi-Task Block Pushing with Zero-Shot Sim-to-Real Transfer
One diffusion policy trained via energy-guided RL solves multi-shape block pushing without demos and transfers zero-shot to real robots under varied conditions.
-
ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
An open-loop generation-then-tracking system maps one egocentric image plus language into Unitree G1 whole-body interactions using only human egocentric motion data.
-
RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking
Residual-action reinforcement learning, with selective corrections on hip and knee pitch joints, enables zero-shot long-horizon dance tracking on real humanoid robots.
-
HERMES: Human-to-Robot Embodied Learning from Multi-Source Motion Data for Mobile Dexterous Manipulation
HERMES converts a single human motion demonstration into a deployable mobile bimanual dexterous manipulation policy, using RL, depth-image distillation, and closed-loop PnP pose refinement.
-
Quantifying and Visualizing Sim-to-Real Gaps: Physics-Guided Regularization for Reproducibility
A gain-regularized, parameter-conditioned RNN balances a low-cost 110:1 gearbox robot with matching simulated and real settling times, while naive domain randomization oscillates.
-
Hierarchical Vision-Language Planning for Multi-Step Humanoid Manipulation
A three-layer hierarchical system using a VLM planner and VLM skill monitor with imitation-learned skills and an RL tracking policy achieved 73% success on a real humanoid pick-and-place task.
-
SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training
SLAC learns a latent action space in a low-fidelity simulator and uses it for real-world reinforcement learning, solving whole-body mobile manipulation tasks in under an hour without demonstrations.
-
Theory Foundation of Physics-Enhanced Residual Learning
A set of conditional bounds shows PERL's advantages follow from assumed smaller Lipschitz constant and loss ceiling, without proving those assumptions or connecting them correctly to neural network training.
-
A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
Embodied intelligence learning is reviewed through the complementary lenses of physical simulators and world models, with a proposed IR-L0 to IR-L4 robot capability taxonomy.
Discussion (0). Sign in to comment.