Pith. sign in

REVIEW 2 major objections 4 cited by

A single navigation model with a reconfigurable interface achieves state-of-the-art results across benchmarks and transfers zero-shot to real robots.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

T0 review · grok-4.3

2026-06-30 10:44 UTC pith:RQU6VXMK

load-bearing objection Qwen-RobotNav sketches a reconfigurable navigation backbone via dual-axis parameters and training randomization, but supplies no numbers, baselines, or coverage details to support the SOTA or robustness claims. the 2 major comments →

arxiv 2606.18112 v3 pith:RQU6VXMK submitted 2026-06-16 cs.RO cs.CV

Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System

classification cs.RO cs.CV
keywords robot navigationagentic systemsparameterized interfacemulti-task trainingscalingzero-shot generalizationvision-language co-trainingspatial planning
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents Qwen-RobotNav as a scalable base model for agentic navigation systems that require the observation strategy to be reconfigured externally at inference time for tasks such as instruction following, object search, target tracking, and autonomous driving. These tasks share a perception-planning backbone yet need different ways to consume the visual stream. The model introduces a parameterized interface consisting of multiple task modes that select navigation behavior and controllable observation parameters that govern visual history encoding. Training-time randomization over all parameters on 15.6 million samples, combined with co-training on vision-language data, produces robustness to any inference-time configuration without architectural changes to the backbone. This design supports an upper-level planner that decomposes long-horizon goals into sub-tasks and switches modes and context strategies mid-episode, yielding new state-of-the-art benchmark performance, favorable scaling from 2B to 8B parameters, a shared spatial-planning substrate across task families, and strong zero-shot generalization to physical robots.

Core claim

Qwen-RobotNav addresses the requirement for a base navigation model whose observation strategy can be externally reconfigured at inference time through a parameterized interface with two complementary dimensions: multiple task modes that select the navigation behaviour, and controllable observation parameters that govern how visual history is encoded. With training-time randomization over all parameters, the model remains robust to any inference-time configuration requiring zero architectural modification. Co-training with vision-language data on 15.6M samples prevents collapse into reactive action-sequence mappers. The resulting model serves as a natural building block for agentic systems,

What carries the argument

The parameterized interface of task modes and observation parameters, made robust by training-time randomization over all parameters on a joint vision-language and navigation dataset.

Load-bearing premise

Training-time randomization over all parameters produces a model that remains robust to any inference-time configuration of task mode and observation parameters without requiring architectural changes.

What would settle it

A controlled test in which the trained model is evaluated on a held-out combination of task mode and observation parameters and shows a sharp drop in success rate compared with configurations seen during randomization, or fails to match the reported zero-shot real-robot performance in a new environment.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • An upper-level planner can decompose long-horizon goals into sub-tasks and dynamically switch Qwen-RobotNav's task mode and context strategy mid-episode.
  • Joint multi-task training develops a shared spatial-planning substrate that transfers across task families.
  • The model exhibits favourable scaling from 2B to 8B parameters.
  • It demonstrates strong zero-shot generalisation to real-world robots across diverse environments.
  • Co-training with vision-language data prevents the collapse into reactive action-sequence mappers observed in trajectory-only training.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The reconfigurable interface could allow a single model to serve multiple embodied tasks beyond navigation if additional modes are added.
  • A shared spatial-planning substrate may mean that joint training reduces the total data needed compared with training separate models for each task family.
  • Extending the randomization procedure to include environment or sensor variations during training could further improve sim-to-real transfer.
  • The design suggests that agentic systems could achieve longer-horizon competence by composing many short calls to the same backbone rather than training monolithic long-horizon policies.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 0 minor

Summary. The paper presents Qwen-RobotNav, a scalable navigation model extending Qwen with a parameterized interface consisting of multiple task modes and controllable observation parameters (e.g., token budget, per-camera weights). Training-time randomization over these parameters is claimed to yield a model robust to any inference-time configuration without architectural modification. The model is trained on 15.6M samples, with co-training on vision-language data to avoid collapse into reactive mappers. The abstract asserts that this yields SOTA results on major navigation benchmarks, favorable scaling from 2B to 8B parameters via a shared spatial-planning substrate, and strong zero-shot generalization to real-world robots.

Significance. If the empirical claims hold with supporting metrics, the parameterized interface could serve as a reusable building block for agentic systems that dynamically switch modes mid-episode, advancing multi-task navigation and reducing the need for task-specific architectures. The scaling and multi-task training observations would contribute to understanding shared representations in robotics. The absence of any quantitative results, however, prevents assessment of whether these benefits materialize.

major comments (2)
  1. [Abstract] Abstract: The central claim that 'training-time randomization over all parameters' produces robustness to 'any inference-time configuration' with zero architectural modification is load-bearing for the reconfigurable building-block use case, yet no details are supplied on the support of the randomization distribution, the ranges sampled for task modes or observation parameters (token budget, per-camera weights), or whether the 15.6M samples cover edge cases. Without this, the zero-shot transfer and shared-substrate claims cannot be evaluated.
  2. [Abstract] Abstract: Assertions of 'new state-of-the-art results across major navigation benchmarks,' 'favourable scaling from 2B to 8B parameters,' and 'strong zero-shot generalisation to real-world robots' are made without any quantitative metrics, baseline comparisons, dataset descriptions, ablation studies, or experimental setup details, rendering the soundness of the empirical contributions impossible to assess from the manuscript.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive comments on the abstract. We agree that additional detail on the randomization procedure and quantitative empirical support are required for the claims to be evaluable. We will revise the manuscript to supply these elements.

read point-by-point responses
  1. Referee: [Abstract] Abstract: The central claim that 'training-time randomization over all parameters' produces robustness to 'any inference-time configuration' with zero architectural modification is load-bearing for the reconfigurable building-block use case, yet no details are supplied on the support of the randomization distribution, the ranges sampled for task modes or observation parameters (token budget, per-camera weights), or whether the 15.6M samples cover edge cases. Without this, the zero-shot transfer and shared-substrate claims cannot be evaluated.

    Authors: We agree the abstract omits these specifics. The revised version will add an explicit description: task modes are sampled uniformly from the set {point navigation, object search, target tracking, lane following}; token budget is drawn uniformly from [64, 4096]; per-camera weights are drawn from a Dirichlet(1,…,1) distribution over the active cameras. The 15.6 M samples were produced by independently resampling all parameters at every training step, explicitly including edge cases (single-camera input, minimal token budgets, and zero-weight cameras). This procedure is what enables the reported robustness to arbitrary inference-time configurations. revision: yes

  2. Referee: [Abstract] Abstract: Assertions of 'new state-of-the-art results across major navigation benchmarks,' 'favourable scaling from 2B to 8B parameters,' and 'strong zero-shot generalisation to real-world robots' are made without any quantitative metrics, baseline comparisons, dataset descriptions, ablation studies, or experimental setup details, rendering the soundness of the empirical contributions impossible to assess from the manuscript.

    Authors: We acknowledge that the current manuscript supplies none of the requested quantitative evidence. In the revision we will (i) insert concrete metrics and baseline comparisons into the abstract, (ii) add a results section containing success-rate tables, scaling curves, ablation studies on the co-training and randomization, and full experimental protocols, and (iii) describe the 15.6 M dataset composition and real-robot evaluation protocol. These additions will allow direct assessment of the SOTA, scaling, and zero-shot claims. revision: yes

Circularity Check

0 steps flagged

No circularity: all claims are empirical results from training and benchmarking with no derivations or self-referential definitions

full rationale

The paper contains no equations, derivations, fitted parameters presented as predictions, or load-bearing self-citations. Claims rest on training 15.6M samples with randomization and reporting benchmark performance plus scaling behavior. The robustness statement is an empirical assertion about the training distribution rather than a quantity defined in terms of itself. No steps reduce by construction to inputs, satisfying the criteria for a self-contained empirical report.

Axiom & Free-Parameter Ledger

2 free parameters · 2 axioms · 0 invented entities

The central claims rest on the unverified assumption that randomization during training confers robustness to arbitrary inference configurations and that vision-language co-training reliably prevents collapse; no free parameters are numerically fitted in the abstract, and no new entities are postulated.

free parameters (2)
  • task modes
    Discrete modes that select navigation behaviour, introduced as part of the interface design.
  • observation parameters
    Controllable values such as token budget and per-camera weights that govern visual encoding.
axioms (2)
  • domain assumption Training-time randomization over task modes and observation parameters produces robustness to any inference-time configuration.
    Invoked to justify the claim of zero architectural modification at inference.
  • domain assumption Co-training with vision-language data prevents collapse into reactive action-sequence mappers.
    Stated as an observed outcome of trajectory-only training.

pith-pipeline@v0.9.1-grok · 5961 in / 1352 out tokens · 36773 ms · 2026-06-30T10:44:29.768414+00:00 · methodology

0 comments
read the original abstract

Agentic navigation systems require a base navigation model whose observation strategy can be externally reconfigured at inference time, because instruction following, object search, target tracking, and autonomous driving share the same perception-planning backbone yet demand fundamentally different strategies for consuming the visual stream. We present Qwen-RobotNav, a scalable navigation model built on Qwen-RobotNav that addresses it through a parameterised interface with two complementary dimensions: multiple task modes that select the navigation behaviour, and controllable observation parameters (e.g., token budget, per-camera weights) that govern how visual history is encoded. With training-time randomization over all parameters, Qwen-RobotNav is robust to any inference-time configuration requiring zero architectural modification to the Qwen-RobotNav backbone. We train Qwen-RobotNav on 15.6M samples; co-training with vision-language data prevents the collapse into reactive action-sequence mappers observed in trajectory-only training. The parameterised interface also makes Qwen-RobotNav a natural building block for agentic systems: for long-horizon scenarios, an upper-level planner decomposes goals into sub-tasks and dynamically switches Qwen-RobotNav's task mode and context strategy mid-episode, composing complex behaviours from repeated calls to the same model. Extensive experiments show that Qwen-RobotNav sets new state-of-the-art results across major navigation benchmarks. The model exhibits favourable scaling from 2B to 8B parameters, with joint multi-task training developing a shared spatial-planning substrate that transfers across task families, and demonstrates strong zero-shot generalisation to real-world robots across diverse environments.

Figures

Figures reproduced from arXiv: 2606.18112 by An Yang, Anzhe Chen, Chenfei Wu, Chenxu Lv, Dayiheng Liu, Fei Huang, Gengze Zhou, Hale Yin, Haoqi Yuan, Haoyang Li, Jiahao Li, Jiazhao Zhang, Jie Zhang, Jingren Zhou, Jingyang Fan, Junyang Lin, Kun Yan, Lulu Hu, Minying Zhang, Pei Lin, Qihang Peng, Shuai Bai, Shurui Li, Wenhu Xiao, Xiao Xu, Xiaoyue Chen, Xiong-Hui Chen, Xuancheng Ren, Xudong Guo, Ye Wang, Yiyang Huang, Zhibo Yang, Zhixuan Liang, Zhuoyuan Yu, Zixing Lei.

Figure 1
Figure 1. Figure 1: Benchmark summary. Across instruction following, object search, target tracking, embodied question answering, and autonomous driving, Qwen-RobotNav-4B and Qwen-RobotNav-8B achieve state-of-the-art or competitive performance against specialist and navigation foundation model baselines. Trophy icons mark the best result in each benchmark group. 1 Introduction Embodied navigation spans a remarkably diverse fa… view at source ↗
Figure 2
Figure 2. Figure 2: Qwen-RobotNav architecture. Top: In the agentic navigation system, an upper planner LLM decomposes long-horizon goals into sub-goals and controls Qwen-RobotNav through task-adaptive context parameters such as token budget B, temporal decay γ, camera weights wc, and frame sampling mode. Bottom: Qwen-RobotNav receives multi-view RGB observations, an embodied prompt, and a navigation instruction; allocates vi… view at source ↗
Figure 3
Figure 3. Figure 3: Visualization of task-adaptive observation encoding. (a) Normalized temporal weights ωt = exp(γ · t/(T ′−1)) for varying decay factors γ when T ′>1; annotations show the newest-to-oldest weight ratio. (b) Resulting per-timestep token budget (summed across all cameras) under a fixed total budget B=3072 with camera weights wc=[2.0, 1.0, 0.5, 1.0] for front, right, back, and left views. The dashed line marks … view at source ↗
Figure 4
Figure 4. Figure 4: Qwen-RobotNav for agentic navigation. An upper-level planner decomposes a long-horizon task into sub-goals and dispatches either auxiliary vision-tool calls or Qwen-RobotNav navigation calls. Each navigation call is parameterized by a sub-goal instruction Li , a task mode τi , and an observation configuration Φi . Qwen-RobotNav uses the selected task mode and configuration to predict waypoints Wi , which a… view at source ↗
Figure 5
Figure 5. Figure 5: Training data distribution. Left: Per-dataset sample counts across all navigation trajectory and vision-language sources. Right: Aggregated distribution over task categories, totalling 15.6M training samples. 4.1 Navigation Trajectory Planning A key design principle of Qwen-RobotNav is to train on a deliberately broad spectrum of navigation tasks rather than specialising in any single paradigm. We structur… view at source ↗
Figure 6
Figure 6. Figure 6: Visualization of the three coordinate-based point-goal navigation categories. [PITH_FULL_IMAGE:figures/full_fig_p012_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Object-goal navigation data generation pipeline. [PITH_FULL_IMAGE:figures/full_fig_p013_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Autogenerated navigation data pipeline. Right: A large language model first generates paired video prompts and navigation instructions; a text-to-video model then synthesises first-person egocentric videos, which are filtered by a vision-language model for quality before a monocular depth-and-pose estimator extracts 2-D trajectories; a final kinematic filter removes physically implausible samples. Left: Tw… view at source ↗
Figure 9
Figure 9. Figure 9: Visual comparison between original Habitat simulator renders (top) and Qwen-Image-Edit ( [PITH_FULL_IMAGE:figures/full_fig_p016_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: Visualization of structured multi-perspective reasoning along a complete navigation trajectory. [PITH_FULL_IMAGE:figures/full_fig_p018_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: Deployment architecture and latency comparison of Qwen-RobotNav-4B on Unitree Go2. [PITH_FULL_IMAGE:figures/full_fig_p019_11.png] view at source ↗
Figure 12
Figure 12. Figure 12: Qualitative closed-loop planning visualization on NAVSIM. We visualize a representative left-turn case in an annular road scene. For each timestep, the figure shows the multi-view camera observations, the predicted future trajectory overlaid on the front-view image, and the corresponding BEV scene. Qwen-RobotNav produces temporally consistent curved trajectories from Step 1 to Step 30, progressively compl… view at source ↗
Figure 13
Figure 13. Figure 13: Qualitative zero-shot closed-loop simulation visualization on AlpaSim. We show two representative cases from the PhysicalAI-AV NuRec dataset. In the first right-turn case, Qwen-RobotNav slows down and proceeds straight after approaching an intersection, then performs a right turn while keeping away from the road boundary, and finally continues forward along the outgoing lane. In the second straight-drivin… view at source ↗
Figure 14
Figure 14. Figure 14: Data scaling behavior of Qwen-RobotNav. Performance on representative navigation benchmarks as a function of the training data fraction. Increasing the amount of navigation training data yields clear gains on most tasks, with especially strong improvements on long-horizon tasks such as VLN-CE RxR, while short-horizon tracking saturates earlier and exhibits mild non-monotonicity. 2048 2560 3072 3584 4096 4… view at source ↗
Figure 15
Figure 15. Figure 15: Ablation on token budget B and temporal decay γ. We evaluate Qwen-RobotNav-4B on 500 VLN-CE R2R Val-Unseen episodes under varying configurations. Left: Sweeping the token budget from 2048 to 4608 at fixed γ=2.0. Right: Sweeping the temporal decay from 0.5 to 3.5 at fixed B=3072. 5.5 Ablation Study Effect of training data scale [PITH_FULL_IMAGE:figures/full_fig_p026_15.png] view at source ↗
Figure 16
Figure 16. Figure 16: Real-world VLN deployment in an unseen exhibition hall. The robot dog navigates 21.78 m from a living room to a medical room following pure language instructions, leveraging different visual landmarks along the route. Upon receiving a reverse language command, the robot precisely walks backward to its original starting position. and returns trajectory evidence for subsequent planning. The real-world episo… view at source ↗
Figure 17
Figure 17. Figure 17: Indoor deployment with verbal commands. The robot executes navigation tasks in an apartment setting using step-by-step verbal instructions, traversing between the bedroom, living room, and bathroom while responding to fine-grained spatial directives. 6 Conclusion We have presented Qwen-RobotNav, a unified navigation model built on Qwen3-VL that reframes the central challenge of multi-task navigation as a … view at source ↗
Figure 18
Figure 18. Figure 18: Real-world long-horizon navigation with agentic Qwen-RobotNav. On a real robot, the agent answers an open-ended request by decomposing the task into sub-goals, following landmarks to Cotti Coffee, and verifying the green umbrella from visual evidence. Selected turns show the loop of upper-level planning, Qwen-RobotNav execution, memory updates, and final response generation. or task-head problem. Our key … view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ABot-N1: Toward a General Visual Language Navigation Foundation Model

    cs.CV 2026-07 conditional novelty 6.0

    A slow–fast VLN model that routes five navigation tasks through CoT plus image-space pixel goals reaches SOTA on established and new urban benchmarks, including 77.3% POI arrival.

  2. ABot-N1: Toward a General Visual Language Navigation Foundation Model

    cs.CV 2026-07 unverdicted novelty 6.0

    ABot-N1 decouples VLN into a slow CoT reasoner that outputs pixel goals and a fast action expert, claiming large SOTA gains on urban POI and multi-task navigation.

  3. ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI

    cs.RO 2026-07 conditional novelty 6.0

    A single 8B backbone unifies spatial perception, decision making, navigation/manipulation, and progress estimation with SSR+ merging, reporting gains on most spatial benchmarks and competitive action/progress results.

  4. A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation

    cs.RO 2026-07 accept novelty 5.5

    VLN methods show a large sim-to-real gap; a hierarchical system reaches 51% real-world success versus 22% for a monolithic RGB-only system across ten physical scenes.

Reference graph

Works this paper leans on

36 extracted references · 36 canonical work pages · cited by 3 Pith papers · 8 internal anchors

  1. [1]

    Objectnav revisited: On evaluation of embodied agents navigating to objects

    Dhruv Batra, Aaron Gokaslan, Aniruddha Kembhavi, Oleksandr Maksymets, Roozbeh Mottaghi, Manolis Savva, Alexander Toshev, and Erik Wijmans. ObjectNav revisited: On evaluation of embodied agents navigating to objects. InarXiv preprint arXiv:2006.13171,

  2. [2]

    CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMs

    URLhttps://internrobotics.github.io/internvla-n1.github.io/. Yihan Cao, Jiazhao Zhang, Zhinan Yu, Shuzhen Liu, Zheng Qin, Qin Zou, Bo Du, and Kai Xu. Cognav: Cognitive process modeling for object goal navigation with llms.arXiv preprint arXiv:2412.10439,

  3. [3]

    †Project lead

    *Equal contribution. †Project lead. ‡Corresponding author. 31 Angel X. Chang, Angela Dai, Thomas A. Funkhouser, Maciej Halber, Matthias Nießner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang. Matterport3d: Learning from RGB-D data in indoor environments. In2017 International Conference on 3D Vision, 3DV 2017, Qingdao, China, October 10- 12, 2017,...

  4. [4]

    URL https: //doi.org/10.1109/3DV.2017.00081

    doi: 10.1109/3DV .2017.00081. URL https: //doi.org/10.1109/3DV.2017.00081. Yitong Chen, Lingchen Meng, Wujian Peng, Zuxuan Wu, and Yu-Gang Jiang. Comp: Continual multi- modal pre-training for vision foundation models.arXiv preprint arXiv:2503.18931, 2025a. Yuntao Chen, Yuqi Wang, and Zhaoxiang Zhang. Drivinggpt: Unifying driving world modeling and plannin...

  5. [5]

    OmniNav: A unified framework for prospec- tive exploration and visual-language navigation.arXiv preprint arXiv:2510.06436,

    Weijing Hu, Jun Wang, Teng Hu, Jiteng Chen, Siwen Xue, Yufeng Yue, Haoran Xie, Weixun Zhang, Huchuan Lu, Zongqing Lu, Haibin He, and Bolei Wang. OmniNav: A unified framework for prospec- tive exploration and visual-language navigation.arXiv preprint arXiv:2510.06436,

  6. [6]

    AstraNav-World: World model for foresight control and consistency.arXiv preprint arXiv:2603.23745,

    Weijing Hu, Jun Wang, Teng Hu, Jiteng Chen, Siwen Xue, Yufeng Yue, Yanyun Wu, Haibin He, Bolei Wang, Huchuan Lu, and Zongqing Lu. AstraNav-World: World model for foresight control and consistency.arXiv preprint arXiv:2603.23745,

  7. [7]

    Beyond the destination: A novel benchmark for exploration-aware embodied question answering

    Kaixuan Jiang, Yang Liu, Weixing Chen, Jingzhou Luo, Ziliang Chen, Ling Pan, Guanbin Li, and Liang Lin. Beyond the destination: A novel benchmark for exploration-aware embodied question answering. InIEEE/CVF International Conference on Computer Vision, ICCV 2025, Honolulu, HI, USA, October 19-25, 2025, pp. 9091–9101. IEEE,

  8. [8]

    FigureQA: An Annotated Figure Dataset for Visual Reasoning

    Samira Ebrahimi Kahou, Vincent Michalski, Adam Atkinson, Ákos Kádár, Adam Trischler, and Yoshua Bengio. Figureqa: An annotated figure dataset for visual reasoning.arXiv preprint arXiv:1710.07300,

  9. [9]

    32 Sahar Kazemzadeh, Vicente Ordonez, Mark Matten, and Tamara L. Berg. Referitgame: Referring to objects in photographs of natural scenes. InProceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, pp. 787–798. ACL,

  10. [10]

    ReferItGame: Referring to objects in photographs of natural scenes

    doi: 10.3115/V1/D14-1086. URL https: //doi.org/10.3115/v1/d14-1086. Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, and Stefan Lee. Beyond the nav-graph: Vision-and-language navigation in continuous environments. InEuropean Conference on Computer Vision (ECCV),

  11. [11]

    Room-across-room: Multilingual vision-and-language navigation with dense spatiotemporal grounding

    Alexander Ku, Peter Anderson, Roma Patel, Eugene Ie, and Jason Baldridge. Room-across-room: Multilingual vision-and-language navigation with dense spatiotemporal grounding. InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 4392–4412,

  12. [12]

    Openfmnav: Towards open-set zero-shot object navigation via vision-language foundation models.arXiv preprint arXiv:2402.10670,

    Yuxuan Kuang, Hai Lin, and Meng Jiang. Openfmnav: Towards open-set zero-shot object navigation via vision-language foundation models.arXiv preprint arXiv:2402.10670,

  13. [13]

    Memory Centric Power Allocation for Multi-Agent Embodied Question Answering

    Chengyang Li, Shuai Wang, Kejiang Ye, Weijie Yuan, Boyu Zhou, Yik-Chung Wu, Cheng-Zhong Xu, and Huseyin Arslan. Memory centric power allocation for multi-agent embodied question answering. CoRR, abs/2604.17810, 2026a. Kailin Li, Zhenxin Li, Shiyi Lan, Yuan Xie, Zhizhong Zhang, Jiayi Liu, Zuxuan Wu, Zhiding Yu, and Jose M Alvarez. Hydra-mdp++: Advancing en...

  14. [14]

    ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving

    Yingyan Li, Yuqi Wang, Yang Liu, Jiawei He, Lue Fan, and Zhaoxiang Zhang. End-to-end driving with online trajectory evaluation via bev world model. InProceedings of the IEEE/CVF International Conference on Computer Vision, pp. 27137–27146, 2025b. Yongkang Li, Kaixin Xiong, Xiangyu Guo, Fang Li, Sixu Yan, Gangwei Xu, Lijun Zhou, Long Chen, Haiyang Sun, Bin...

  15. [15]

    Vlnverse: A benchmark for vision-language navigation with versatile, embodied, realistic simulation and evaluation.arXiv preprint arXiv:2512.19021, 2025

    Sihao Lin, Zerui Li, Xunyi Zhao, Gengze Zhou, Liuyi Wang, Rong Wei, Rui Tang, Juncheng Li, Hanqing Wang, Jiangmiao Pang, Anton van den Hengel, Jiajun Liu, and Qi Wu. Vlnverse: A benchmark for vision-language navigation with versatile, embodied, realistic simulation and evaluation.CoRR, abs/2512.19021,

  16. [17]

    Trackvla++: Unleashing reasoning and memory capabilities in vla models for embodied visual tracking.arXiv preprint arXiv:2510.07134,

    Jiahang Liu, Yunpeng Qi, Jiazhao Zhang, Minghan Li, Shaoan Wang, Kui Wu, Hanjing Ye, Hong Zhang, Zhibo Chen, Fangwei Zhong, et al. Trackvla++: Unleashing reasoning and memory capabilities in vla models for embodied visual tracking.arXiv preprint arXiv:2510.07134,

  17. [18]

    Instructnav: Zero-shot system for generic instruction navigation in unexplored environment

    Yuxing Long, Wenzhe Cai, Hongcheng Wang, Guanqi Zhan, and Hao Dong. Instructnav: Zero-shot system for generic instruction navigation in unexplored environment. In Pulkit Agrawal, Oliver Kroemer, and Wolfram Burgard (eds.),Conference on Robot Learning, 6-9 November 2024, Munich, Germany, Proceedings of Machine Learning Research, pp. 2049–2060. PMLR,

  18. [19]

    Decoupled weight decay regularization

    33 Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. In7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9,

  19. [20]

    WMNav: Integrating vision- language models into world models for object goal navigation

    Dujun Nie, Xianda Guo, Yiqun Duan, Ruijun Zhang, and Long Chen. Wmnav: Integrating vision- language models into world models for object goal navigation.arXiv preprint arXiv:2503.02247,

  20. [21]

    Turner, Eric Undersander, Wojciech Galuba, Andrew Westbury, Angel X

    Santhosh Kumar Ramakrishnan, Aaron Gokaslan, Erik Wijmans, Oleksandr Maksymets, Alexan- der Clegg, John M. Turner, Eric Undersander, Wojciech Galuba, Andrew Westbury, Angel X. Chang, Manolis Savva, Yili Zhao, and Dhruv Batra. Habitat-matterport 3d dataset (HM3D): 1000 large-scale 3d environments for embodied AI. InProceedings of the Neural Information Pro...

  21. [22]

    URL https://datasets-benchmarks-proceedings.neurips.cc/paper/2021/hash/ 34173cb38f07f89ddbebc2ac9128303f-Abstract-round2.html. Allen Z. Ren, Jaden Clark, Anushri Dixit, Masha Itkina, Anirudha Majumdar, and Dorsa Sadigh. Explore until confident: Efficient exploration for embodied question answering. In Dana Kulic, Gentiane Venture, Kostas E. Bekris, and En...

  22. [23]

    Habitat: A platform for embodied AI research

    Manolis Savva, Jitendra Malik, Devi Parikh, Dhruv Batra, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, and Vladlen Koltun. Habitat: A platform for embodied AI research. In2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, pp. 9338...

  23. [24]

    Detection of Interest Points Using Symmetry

    doi: 10.1109/ICCV .2019.00943. URLhttps://doi.org/10.1109/ICCV.2019.00943. Saumya Saxena, Blake Buchanan, Chris Paxton, Bingqing Chen, Narunas Vaskevicius, Luigi Palmieri, Jonathan Francis, and Oliver Kroemer. Grapheqa: Using 3d semantic scene graphs for real-time embodied question answering.CoRR, abs/2412.14480,

  24. [25]

    SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

    34 Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, et al. Siglip 2: Multilingual vision-language encoders with improved semantic understanding, localization, and dense features. arXiv preprint arXiv:2502.14786,

  25. [27]

    Walk forward

    Zun Wang, Jialu Li, Yicong Hong, Songze Li, Kunchang Li, Shoubin Yu, Yi Wang, Yu Qiao, Yali Wang, Mohit Bansal, and Limin Wang. Bootstrapping language-guided navigation learning with self-refining data flywheel. InInternational Conference on Learning Representations, volume 2025, pp. 23542–23568, 2025c. Meng Wei, Chenyang Wan, Jiaqi Peng, Xiqian Yu, Yuqia...

  26. [28]

    Qwen-Image Technical Report

    Chenfei Wu, Jiahao Li, Jingren Zhou, Junyang Lin, Kaiyuan Gao, Kun Yan, Shengming Yin, Shuai Bai, Xiao Xu, Yilei Chen, Yuxiang Chen, Zecheng Tang, Zekai Zhang, Zhengyi Wang, An Yang, Bowen Yu, Chen Cheng, Dayiheng Liu, Deqing Li, Hang Zhang, Hao Meng, Hu Wei, Jingyuan Ni, Kai Chen, Kuan Cao, Liang Peng, Lin Qu, Minggang Wu, Peng Wang, Shuting Yu, Tingkun ...

  27. [29]

    Qwen-Image Technical Report

    doi: 10.48550/ARXIV .2508.02324. URL https://doi.org/10.48550/arXiv.2508.02324. Ziyuan Xia, Jingyi Xu, Chong Cui, Yuanhong Yu, Jiazhao Zhang, Qingsong Yan, Tao Ni, Junbo Chen, Xiaowei Zhou, Hujun Bao, et al. Habitat-gs: A high-fidelity navigation simulator with dynamic gaussian splatting.arXiv preprint arXiv:2604.12626,

  28. [30]

    Qwen3 technical report, 2025a

    An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, et al. Qwen3 technical report, 2025a. Yuncong Yang, Han Yang, Jiachen Zhou, Peihao Chen, Hongxin Zhang, Yilun Du, and Chuang Gan. 3d- mem: 3d scene memory for embodied exploration and reasoning. InIEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nas...

  29. [31]

    Gc-vln: Instruction as graph constraints for training-free vision-and-language navigation.arXiv preprint arXiv:2509.10454, 2025a

    Hang Yin, Haoyu Wei, Xiuwei Xu, Wenxuan Guo, Jie Zhou, and Jiwen Lu. Gc-vln: Instruction as graph constraints for training-free vision-and-language navigation.arXiv preprint arXiv:2509.10454, 2025a. 35 Hang Yin, Xiuwei Xu, Linqing Zhao, Ziwei Wang, Jie Zhou, and Jiwen Lu. Unigoal: Towards universal zero-shot goal-oriented navigation.arXiv preprint arXiv:2...

  30. [32]

    Vlfm: Vision- language frontier maps for zero-shot semantic navigation

    Naoki Yokoyama, Sehoon Ha, Dhruv Batra, Jiuguang Wang, and Bernadette Bucher. Vlfm: Vision- language frontier maps for zero-shot semantic navigation. In2024 IEEE International Conference on Robotics and Automation (ICRA), pp. 42–48. IEEE, 2024a. Naoki Yokoyama, Ram Ramrakhya, Abhishek Das, Dhruv Batra, and Sehoon Ha. HM3D-OVON: A dataset and benchmark for...

  31. [33]

    Poliformer: Scaling on- policy rl with transformers results in masterful navigators,

    Kuo-Hao Zeng, Zichen Zhang, Kiana Ehsani, Rose Hendrix, Jordi Salvador, Alvaro Herrasti, Ross Girshick, Aniruddha Kembhavi, and Luca Weihs. Poliformer: Scaling on-policy rl with transformers results in masterful navigators.arXiv preprint arXiv:2406.20083,

  32. [34]

    FAST-EQA: efficient embodied question answering with global and local region relevancy

    Haochen Zhang, Nirav Savaliya, Faizan Siddiqui, and Enna Sachdeva. FAST-EQA: efficient embodied question answering with global and local region relevancy. InIEEE/CVF Winter Conference on Ap- plications of Computer Vision, WACV 2026, Tucson, AZ, USA, March 6-10, 2026, pp. 1664–1673. IEEE,

  33. [35]

    NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation

    Jiazhao Zhang, Kunyu Wang, Rongtao Xu, Gengze Zhou, Yicong Hong, Xiaomeng Fang, Qi Wu, Zhizheng Zhang, and He Wang. Navid: Video-based vlm plans the next step for vision-and-language navigation. arXiv preprint arXiv:2402.15852, 2024a. Jiazhao Zhang, Anqi Li, Yunpeng Qi, Minghan Li, Jiahang Liu, Shaoan Wang, Haoran Liu, Gengze Zhou, Yuze Wu, Xingxing Li, e...

  34. [36]

    Vln-mme: Diagnosing mllms as language-guided visual navigation agents.arXiv preprint arXiv:2512.24851,

    Xunyi Zhao, Gengze Zhou, and Qi Wu. Vln-mme: Diagnosing mllms as language-guided visual navigation agents.arXiv preprint arXiv:2512.24851,

  35. [37]

    Denseg: Alleviating vision-language feature sparsity in multi-view 3d visual grounding

    Henry Zheng, Hao Shi, Yong Xien Chng, Rui Huang, Zanlin Ni, Tianyi Tan, Qihang Peng, Yepeng Weng, Zhongchao Shi, and Gao Huang. Denseg: Alleviating vision-language feature sparsity in multi-view 3d visual grounding. InAutonomous Grand Challenge CVPR 2024 Workshop, volume 2, pp. 6,

  36. [38]

    AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

    Gengze Zhou, Yicong Hong, Zun Wang, Xin Eric Wang, and Qi Wu. Navgpt-2: Unleashing navigational reasoning capability for large vision-language models. InEuropean Conference on Computer Vision, pp. 260–278. Springer, 2024a. 36 Gengze Zhou, Yicong Hong, and Qi Wu. Navgpt: Explicit reasoning in vision-and-language navigation with large language models. InPro...