REVIEW 6 cited by
Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flight
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Learning visuomotor policies for agile quadrotor flight presents significant difficulties, primarily from inefficient policy exploration caused by high-dimensional visual inputs and the need for precise and low-latency control. To address these challenges, we propose a novel approach that combines the performance of Reinforcement Learning (RL) and the sample efficiency of Imitation Learning (IL) in the task of vision-based autonomous drone racing. While RL provides a framework for learning high-performance controllers through trial and error, it faces challenges with sample efficiency and computational demands due to the high dimensionality of visual inputs. Conversely, IL efficiently learns from visual expert demonstrations, but it remains limited by the expert's performance and state distribution. To overcome these limitations, our policy learning framework integrates the strengths of both approaches. Our framework contains three phases: training a teacher policy using RL with privileged state information, distilling it into a student policy via IL, and adaptive fine-tuning via RL. Testing in both simulated and real-world scenarios shows our approach can not only learn in scenarios where RL from scratch fails but also outperforms existing IL methods in both robustness and performance, successfully navigating a quadrotor through a race course using only visual information. Videos of the experiments are available at https://rpg.ifi.uzh.ch/bootstrap-rl-with-il/index.html.
Forward citations
Cited by 6 Pith papers
-
Neuromorphic Attitude Estimation and Control
A spiking neural network trained by imitation can perform attitude estimation and control of a tiny quadrotor on real hardware, tracking commands within 3.03 degrees on average versus 2.67 degrees for the standard PID stack.
-
Shared Voxel-Map-Based Cooperative Indoor UAV Guidance with a Multi-Agent Soft Actor-Critic Controller
A multi-agent SAC controller using a shared voxel-map BEV representation achieves 90.3% simulated corridor success and 100% success across 50 real two-drone indoor trials after A*-based imitation fine-tuning.
-
State-Conditional Adversarial Learning: An Off-Policy Visual Domain Transfer Method for End-to-End Imitation Learning
SCAL derives an upper bound on target-domain imitation loss using source loss plus state-conditional latent KL divergence and aligns distributions via a discriminator-based adversarial estimator.
-
Learning to Dock: A Simulation-based Study on Closing the Sim2Real Gap in Autonomous Underwater Docking
In a simulation study, a naively trained AUV docking policy is competitive with domain-randomized and history-conditioned policies under payload variation, with robustness tricks giving only marginal gains in extreme cases.
-
Depth Transfer: Learning to See Like a Simulator for Real-World Drone Navigation
A domain-adaptation method aligns stereo depth images with simulated ground-truth depth in a VAE latent space, letting an RL drone navigation policy trained in IsaacGym transfer to AvoidBench and the real world withou...
-
Imperative MPC: An End-to-End Self-Supervised Learning with Differentiable MPC for UAV Attitude Control
A self-supervised framework jointly trains an IMU-denoising network and a differentiable MPC through a consistency loss, improving simulated quadrotor attitude control and parameter identification.
Discussion (0). Continue with ORCID to comment.