SHAC-ASAM, which wraps the SHAC policy gradient with ASAM, shows improved tolerance to action noise and friction variations in simulated Ant and Humanoid walking tasks, but does not measure whether the learned minima are actually flatter.
Contact Models in Robotics: a Comparative Analysis
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Physics simulation is ubiquitous in robotics. Whether in model-based approaches (e.g., trajectory optimization), or model-free algorithms (e.g., reinforcement learning), physics simulators are a central component of modern control pipelines in robotics. Over the past decades, several robotic simulators have been developed, each with dedicated contact modeling assumptions and algorithmic solutions. In this article, we survey the main contact models and the associated numerical methods commonly used in robotics for simulating advanced robot motions involving contact interactions. In particular, we recall the physical laws underlying contacts and friction (i.e., Signorini condition, Coulomb's law, and the maximum dissipation principle), and how they are transcribed in current simulators. For each physics engine, we expose their inherent physical relaxations along with their limitations due to the numerical techniques employed. Based on our study, we propose theoretically grounded quantitative criteria on which we build benchmarks assessing both the physical and computational aspects of simulation. We support our work with an open-source and efficient C++ implementation of the existing algorithmic variations. Our results demonstrate that some approximations or algorithms commonly used in robotics can severely widen the reality gap and impact target applications. We hope this work will help motivate the development of new contact models, contact solvers, and robotic simulators in general, at the root of recent progress in motion generation in robotics.
citation-role summary
citation-polarity summary
fields
cs.RO 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Improving generalization of robot locomotion policies via Sharpness-Aware Reinforcement Learning
SHAC-ASAM, which wraps the SHAC policy gradient with ASAM, shows improved tolerance to action noise and friction variations in simulated Ant and Humanoid walking tasks, but does not measure whether the learned minima are actually flatter.