pith. sign in

arxiv: 2606.01205 · v1 · pith:H7DKFFH4new · submitted 2026-05-31 · 💻 cs.RO

ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planning

classification 💻 cs.RO
keywords imagineuavnavigationaerialimagination-drivenkinodynamicmodelingvision-languageworld-action
0
0 comments X
read the original abstract

Vision-language navigation (VLN) for UAVs demands grounding free-form instructions into 6-DoF flight under partial observability. While Vision-Language-Action (VLA) models excel at semantic reasoning, they suffer from brittleness due to geometric inconsistency and dynamics mismatch. To address this, we propose ImagineUAV, an imagination-driven framework leveraging cascaded world-action modeling. Instead of direct regression, ImagineUAV employs a latent video diffusion model to generate instruction-conditioned future observations, explicitly imagining environmental evolution, from which 6-DoF motions are inferred via an action extractor. A kinodynamic planner then refines these estimates into collision-free trajectories. Additionally, a step-distilled inference pipeline ensures real-time execution. With only 1.3B parameters, ImagineUAV outperforms prior VLN and VLA baselines on benchmarks and real-world flights, validating the practicality of imagination-driven aerial navigation.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.