A Differentiable Physics Engine for Deep Learning in Robotics
read the original abstract
An important field in robotics is the optimization of controllers. Currently, robots are often treated as a black box in this optimization process, which is the reason why derivative-free optimization methods such as evolutionary algorithms or reinforcement learning are omnipresent. When gradient-based methods are used, models are kept small or rely on finite difference approximations for the Jacobian. This method quickly grows expensive with increasing numbers of parameters, such as found in deep learning. We propose the implementation of a modern physics engine, which can differentiate control parameters. This engine is implemented for both CPU and GPU. Firstly, this paper shows how such an engine speeds up the optimization process, even for small problems. Furthermore, it explains why this is an alternative approach to deep Q-learning, for using deep learning in robotics. Finally, we argue that this is a big step for deep learning in robotics, as it opens up new possibilities to optimize robots, both in hardware and software.
This paper has not been read by Pith yet.
Forward citations
Cited by 6 Pith papers
-
RigPI: Dynamic Parameter Identification of Rigid Body via VLM-Seeded Differentiable Simulation
RigPI combines VLM semantic priors with two-stage gradient optimization in differentiable simulation to identify inertial and frictional parameters of rigid bodies from robot-object interactions.
-
Ensemble Distributionally Robust Bayesian Optimisation with Continuous Context
A tractable ensemble distributionally robust Bayesian optimization method achieves improved sublinear regret bounds under context uncertainty.
-
Ensemble Distributionally Robust Bayesian Optimisation with Continuous Context
EDRBO uses ensemble surrogates and Wasserstein ambiguity sets to robustify BO acquisition functions against context distribution mismatch, with sublinear regret O(γ_T √T) and SOTA empirical results on continuous contexts.
-
RigPI: Dynamic Parameter Identification of Rigid Body via VLM-Seeded Differentiable Simulation
RigPI combines VLM initialization with two-stage gradient-based optimization in differentiable simulation to estimate dynamic parameters of rigid bodies from real robot interactions.
-
Fast Bayesian equipment condition monitoring via simulation based inference: applications to heat exchanger health
Amortized neural posterior estimation via simulation-based inference delivers 82x faster inference than MCMC for heat exchanger fouling and leakage diagnosis while maintaining comparable accuracy on synthetic data.
-
Integrating Mechanistic and Data-Driven Models for Neurological Disorders through Differentiable Programming
This perspective paper categorizes hybrid architectures for combining mechanistic and data-driven models using residual learning, Neural ODEs, and solver-in-the-loop to model neurological disorder progression.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.