REVIEW 18 cited by
HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly and fragile hardware setups. To accelerate algorithmic research in humanoid robots, we present a high-dimensional, simulated robot learning benchmark, HumanoidBench, featuring a humanoid robot equipped with dexterous hands and a variety of challenging whole-body manipulation and locomotion tasks. Our findings reveal that state-of-the-art reinforcement learning algorithms struggle with most tasks, whereas a hierarchical learning approach achieves superior performance when supported by robust low-level policies, such as walking or reaching. With HumanoidBench, we provide the robotics community with a platform to identify the challenges arising when solving diverse tasks with humanoid robots, facilitating prompt verification of algorithms and ideas. The open-source code is available at https://humanoid-bench.github.io.
Forward citations
Cited by 18 Pith papers
-
V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control
V-Simba, a visual RL architecture combining layer normalization, weight decay, and a distributional critic, matches or outperforms complex baselines on 29 continuous control tasks while using less compute.
-
First Deployable Dynamic-CoM: A Unified Policy and Method-Agnostic Benchmark for Humanoid Single-Leg Balance
A support-relative dynamic capture-point observation, reconstructible without base linear velocity, lets a humanoid policy hold clean single-leg balance at 86/90 in simulation and deploy on a Unitree G1 without distillation.
-
Mean Flow Policy Optimization
Mean Flow Policy Optimization (MFPO) uses few-step flow-based models for RL policies and achieves performance on par with or better than diffusion-based methods while substantially lowering training and inference time...
-
PHUMA: Physically Reliable Humanoid Locomotion Dataset
PHUMA is a curated 73-hour humanoid locomotion corpus whose physical-reliability metrics are partly defined by the same losses used to optimize it, and whose imitation success claims are confounded by in-distribution ...
-
Non-conflicting Energy Minimization in Reinforcement Learning based Robot Control
PEGrad projects energy-minimization gradients orthogonal to task-reward gradients in RL, achieving 64% torque reduction in simulation and reduced battery draw on a Unitree Go2 without sacrificing task reward.
-
Sari Sandbox: A Virtual Retail Store Environment for Embodied AI Agents
A photorealistic Unity-based retail store environment with 250 items, a Python API, and a VR human-demonstration benchmark for embodied AI shopping agents.
-
Benchmarking Massively Parallelized Multi-Task Reinforcement Learning for Robotics Tasks
The paper introduces MTBench, a GPU-accelerated benchmark for massively parallel multi-task RL, and reports experiments suggesting on-policy methods outperform off-policy baselines while value learning limits MTRL per...
-
DoublyAware: Dual Planning and Policy Awareness for Temporal Difference Learning in Humanoid Locomotion
DoublyAware combines conformal trajectory filtering with a group-relative policy constraint to improve sample efficiency of TD-MPC for simulated humanoid locomotion.
-
SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending
SkillBlender pretrains reusable goal-conditioned skills and blends them with softmax per-joint weights to solve simulated humanoid loco-manipulation tasks with one or two reward terms.
-
Towards a Generalizable Bimanual Foundation Policy via Flow-based Video Prediction
CogRobot uses optical flow as an intermediate variable to fine-tune a text-to-video model for predicting bimanual robot trajectories, then maps those predictions to actions with a goal-conditioned diffusion policy.
-
Bigger, Regularized, Categorical: High-Capacity Value Functions are Efficient Multi-Task Learners
A single multi-task RL agent using a large regularized critic, categorical value loss, and task embeddings achieves state-of-the-art results across 283 tasks and transfers efficiently to new tasks.
-
WorldEval: World Model as Real-World Robot Policies Evaluator
WorldEval conditions a video generation model on a policy's internal action embeddings (Policy2Vec) and shows generated-video success rates correlate with real-world robot success rates.
-
TD-M(PC)$^2$: Improving Temporal Difference MPC Through Policy Constraint
TD-M(PC)2 adds a TD3-BC-style policy constraint to TD-MPC2's policy update, reducing out-of-distribution value queries caused by planner-data mismatch and improving performance on high-dimensional control tasks.
-
Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking
Mimicking-Bench provides six humanoid-scene interaction tasks with 23K human motion references and a retarget-track-imitate pipeline that beats data-free RL on average success.
-
Simplicial Embeddings Improve Sample Efficiency in Actor-Critic Agents
Simplicial embeddings — group-wise softmax feature layers — improve sample efficiency and final performance of FastTD3, FastSAC, and PPO across continuous- and discrete-control benchmarks at no meaningful runtime cost.
-
GBC: Generalized Behavior-Cloning Framework for Whole-Body Humanoid Imitation
GBC unifies MoCap retargeting and imitation learning into one framework that trains whole-body humanoid policies across multiple robot morphologies in simulation.
-
A Forget-and-Grow Strategy for Deep Reinforcement Learning Scaling in Continuous Control
Forget and Grow (FoG) combines decaying replay weights for old experiences with progressive critic-network expansion to improve continuous-control reinforcement learning, beating BRO, SimBa, and TD-MPC2 on most of 41 ...
-
Scaling DRL for Decision Making: A Survey on Data, Network, and Training Budget Strategies
A survey that categorizes deep reinforcement learning scaling strategies into data, network, and training budget dimensions and outlines challenges for scaling DRL systems.
Discussion (0). Continue with ORCID to comment.