REVIEW 12 cited by
Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present Human to Humanoid (H2O), a reinforcement learning (RL) based framework that enables real-time whole-body teleoperation of a full-sized humanoid robot with only an RGB camera. To create a large-scale retargeted motion dataset of human movements for humanoid robots, we propose a scalable "sim-to-data" process to filter and pick feasible motions using a privileged motion imitator. Afterwards, we train a robust real-time humanoid motion imitator in simulation using these refined motions and transfer it to the real humanoid robot in a zero-shot manner. We successfully achieve teleoperation of dynamic whole-body motions in real-world scenarios, including walking, back jumping, kicking, turning, waving, pushing, boxing, etc. To the best of our knowledge, this is the first demonstration to achieve learning-based real-time whole-body humanoid teleoperation.
Forward citations
Cited by 12 Pith papers
-
Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation
Adding a panoramic camera feed to a vision-language-action policy raises end-to-end success on four real-world mobile two-arm tasks from 30% to 73%.
-
Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills
A taxonomy of robot learning on a weights-versus-skills axis, with a five-rung self-improvement ladder whose top cell (feedback plus memory plus search) holds only a few recent systems.
-
GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking
Online co-training of a text-to-motion generator and a humanoid tracker on simulated G1 improves generator executability and zero-shot tracker coverage beyond static replay or one-way filtering.
-
SafeMimic: Towards Safe and Autonomous Human-to-Robot Imitation for Mobile Manipulation
SafeMimic enables a mobile robot to safely and autonomously adapt a single third-person human video into a successful multi-step manipulation strategy.
-
GMT: General Motion Tracking for Humanoid Whole-Body Control
GMT trains a single unified humanoid policy using adaptive sampling and mixture-of-experts, achieving lower tracking errors than a re-implemented ExBody2 across diverse whole-body motions.
-
From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots
BumbleBee, an expert-to-generalist pipeline using autoencoder-based motion clustering and per-cluster delta action models, reports state-of-the-art whole-body control on a Unitree G1 humanoid, with success rates of 89...
-
SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending
SkillBlender pretrains reusable goal-conditioned skills and blends them with softmax per-joint weights to solve simulated humanoid loco-manipulation tasks with one or two reward terms.
-
Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Control
A slow-fast two-agent reinforcement learning architecture with separate upper- and lower-body policies reduces end-effector shaking during humanoid locomotion.
-
HuBE: Cross-Embodiment Human-like Behavior Execution for Humanoid Robots
HuBE is a closed-loop pose-generation framework that produces context-appropriate, human-like upper-body motions for multiple humanoid robots, trained on an LLM-annotated dataset with bone-scaling augmentation.
-
EMP: Executable Motion Prior for Humanoid Robot Standing Upper-body Motion Imitation
A state-conditioned executable motion prior network modifies upper-body motion targets so a humanoid can imitate human gestures while maintaining balance.
-
Realizing Text-Driven Motion Generation on NAO Robot: A Reinforcement Learning-Optimized Control Pipeline
A text-to-motion diffusion model paired with a norm-position/rotation mapping network and a sim-to-real reinforcement learning controller enables a NAO robot to perform queried gestures such as waving and boxing.
-
Immersive Social Interaction with VR and LLM-Assisted Humanoids
Novice operators achieved 80% success on object manipulation and 70% on social cube-passing using a VR-and-LLM-assisted humanoid teleoperation framework on a Unitree H1.
Discussion (0). Sign in to comment.