A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation

Chengju Liu; Haojie Dai; Jingwei Yang; Jinlong Li; Kai Sheng; Liuyi Wang; Qijun Chen; Qingqing Yan; Xiangyi Wang; Yongrui Qin

REVIEW 2 major objections 5 minor 282 references

A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation

T0 review · 2 major / 5 minor · reviewed 2026-07-14 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read VLN methods that look strong in simulation often fail on real robots; hierarchical stacks hold up better than pure RGB end-to-end ones under the tested setups.

desk verdict Solid survey plus a carefully caveated 10-scene robot study that quantifies a large sim-to-real gap; the architectural comparison is system-level, not pure, and the authors say so. read the letter →

arxiv 2607.09792 v1 pith:GBH3EJZG submitted 2026-07-09 cs.RO cs.AI

Liuyi Wang , Kai Sheng , Zongtao He , Jinlong Li , Yongrui Qin , Haojie Dai , Xiangyi Wang , Jingwei Yang

show 3 more authors

Qingqing Yan Chengju Liu Qijun Chen

This is my paper · ORCID

classification cs.ROcs.AI

keywords vision-and-languagenavigationembodiedAIsim-to-realgaphierarchicalmonolithicpoliciesreal-worldrobotevaluationcollisionavoidancesemanticstopping

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Vision-and-language navigation asks a robot to follow free-form spoken or written instructions using only what it sees, without a pre-built map. Most published numbers come from clean simulators, where success rates can exceed 85 percent. This paper organizes the whole field into hierarchical versus monolithic action designs and discriminative versus generative model designs, then puts two representative systems on a physical wheeled robot in ten real scenes. A monolithic RGB-only method that scores 61 percent success in simulation falls to 22 percent in the real world, while a hierarchical system that plans waypoints and uses LiDAR/SLAM reaches 51 percent success and far fewer collisions. The gap is not just a number: real cameras introduce blur and lighting change, robots slip and collide, and agents often cannot decide when an instruction has been satisfied. The authors treat these results as evidence that current VLN research must close perception, stopping, and safety gaps before the technology is ready for open environments.

What carries the argument

A two-by-two taxonomy of VLN methods (hierarchical vs. monolithic action paradigms crossed with discriminative vs. generative model paradigms) used both to structure the literature review and to select the two representative system configurations that are then run head-to-head on a real wheeled robot.

What would settle it

Rerun the same two system configurations on a different physical robot and a new set of real scenes that still follow the paper’s instruction mix; if the hierarchical system no longer shows substantially higher success and lower collisions than the monolithic RGB-only system, the claimed robustness difference does not generalize.

Watch

Extended reading notes

Core claim

Under the tested configurations, current VLN systems suffer a large simulation-to-real gap: a representative monolithic RGB-only method drops from 61 percent success in simulation to 22 percent on a physical robot across ten diverse scenes, while a hierarchical waypoint-based system reaches 51 percent real-world success with a markedly lower collision rate, indicating greater robustness for the hierarchical stack in this evaluation setting.

Load-bearing premise

That the two chosen systems, the fixed three-meter success rule, the single random seed, and the ten chosen scenes are enough to speak for architectural differences rather than just the specific sensors, robot, and rooms used.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The useful part of this paper is not another VLN taxonomy. It is the 200-episode physical-robot evaluation across ten scenes, with matched starts and instructions, reporting a clear drop for a monolithic RGB-only stack (61% sim SR to 22% real) against 51% real SR and much lower collision rate for a hierarchical panoramic + LiDAR/SLAM stack. That is new empirical evidence the field actually needs.

The two-axis taxonomy (hierarchical/monolithic × discriminative/generative) is clean and usable. Coverage of datasets, simulators, metrics, and recent foundation-model work is thorough. Strengths/limitations sections are honest rather than cheerleading. Extra metrics (SSR for semantic stopping, CR for collisions) and the qualitative failure cases (FOV limits, below-LiDAR obstacles, intention/backtracking stopping failures) are practical and well chosen.

The soft spot is real but already flagged by the authors in Sec. V-B and the abstract: the comparison confounds architecture with sensing, mapping, and control. CLASH gets panorama + SLAM; JanusVLN is monocular RGB-only. You cannot read the 51% vs 22% as pure hierarchical-vs-monolithic superiority. Single seed, fixed 3 m threshold, one robot platform, and ten scenes further limit generality. Those are ordinary experimental limits, not hidden ones.

Math and formal claims are light (standard POMDP framing, ordinary metrics); no circular constructions. Citations look current and balanced. Free parameters (d_th, instruction mix, camera height) are explicit.

This is for people building or evaluating real mobile VLN systems, and for anyone still treating sim leaderboards as the main signal. It deserves a serious referee. I would cite the real-world numbers and the failure analysis; I would not over-cite the taxonomy as novel. Engage with it.

Referee Report

2 major / 5 minor

Summary. This manuscript surveys embodied Vision-and-Language Navigation (VLN) and organizes methods along two orthogonal axes: action paradigms (hierarchical waypoint-based vs. monolithic action-based) and model paradigms (discriminative vs. generative). It reviews problem formulations, datasets, simulators, and metrics, then analyzes strengths and limitations of each paradigm. The distinctive contribution is a systematic real-world evaluation on a wheeled robot across ten diverse scenes (200 episodes total): under the tested configurations, a representative monolithic RGB-only method (JanusVLN) drops from 61% SR in simulation to 22% in the real world, while a hierarchical system (CLASH with panoramic sensing and LiDAR/SLAM) achieves 51% real-world SR and substantially lower collision rate (7% vs. 51%). The authors introduce stricter metrics (SSR, CR), analyze intention/backtracking instructions, and discuss sim-to-real failure modes and future directions.

Significance. If the reported measurements hold, the paper supplies a timely dual contribution: a structured taxonomy of a rapidly diversifying VLN literature, and rare physical-robot evidence of a large sim-to-real gap under controlled, multi-scene conditions. The careful scoping of claims to system configurations (rather than pure architecture isolation), the addition of SSR and collision rate, and the qualitative collision analysis are concrete strengths that the community can use for deployment-oriented research. The work is valuable as a reference and as an empirical baseline for safer, more transferable VLN systems.

major comments (2)

[Abstract; Sec. I; Sec. V-B] Sec. V-A/V-B and abstract: The central comparison confounds action paradigm with sensing and control stack (panoramic + LiDAR/SLAM hierarchical vs. monocular RGB-only monolithic). The manuscript already caveats this in Sec. V-B, but the abstract and Sec. I still lead with hierarchical vs. monolithic labels. Please rephrase the abstract and contribution bullets so that system configuration (sensors, mapping, controller) is primary and paradigm labels secondary, so readers cannot misread the 51% vs. 22% result as a pure architecture effect.
[Sec. V-A; Sec. V-B; Figs. 15–17] Sec. V-A.3–V-B: The real-world protocol uses one trial per episode with a fixed seed (42) and reports point estimates only (e.g., SR 22%/51%, CR 51%/7%). For a claim of a substantial sim-to-real gap across ten scenes, please add uncertainty quantification (bootstrap or binomial CIs per metric, and/or per-scene variance) and state whether any episodes were re-run after collisions or communication failures. This is load-bearing for the quantitative headline numbers.

minor comments (5)

[Fig. 3; Index Terms; Sec. I] Fig. 3 and keywords contain typos: “Anlysis,” “Strenghs,” “evluation” (Sec. I), “Moultimodal.” Please proofread section titles and the keyword list.
[Table III; Sec. IV-C] Table III and related text: GPU-hour and training-data summaries for monolithic foundation models are useful; a short parallel table or paragraph for hierarchical generative systems (e.g., CLASH, InternVLA-N1) would improve balance.
[Sec. II-C; Sec. V-A.4] Sec. II-C metrics: nDTW/sDTW and RGS/RGSPL are defined carefully; briefly note which of these (if any) were computable in the real-world study and why SR/SSR/CR were preferred.
[Fig. 12] Fig. 12 scene labels mix Chinese and English in the source layout description; ensure the published figure uses consistent English labels matching the caption (S1–S10).
[Sec. VI-B; Fig. 20] Sec. VI-B future directions are broad; one sentence each tying lifelong memory, counterfactual world models, and safety metrics back to the specific failure modes in Fig. 20 would tighten the link from evaluation to roadmap.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: taxonomy is descriptive and the load-bearing sim-to-real numbers are new physical measurements, not rearrangements of fitted inputs or self-defined quantities.

full rationale

This is a survey-plus-empirical-evaluation paper, not a first-principles derivation. The methodological taxonomy (hierarchical vs. monolithic; discriminative vs. generative) is an organizational classification of prior work and does not claim to derive performance from axioms. The central quantitative claim—monolithic RGB-only SR falling from 61% in simulation to 22% in real-world deployment, versus hierarchical real-world SR of 51% and much lower collision rate—is obtained by running two representative systems on a physical wheeled platform across ten scenes and 200 episodes, then computing standard navigation metrics (SR, SSR, OSR, CR). Those rates are external measurements against ground-truth goals and human semantic annotations, not quantities defined in terms of the paper’s own parameters. Self-citations (e.g., CLASH as the hierarchical baseline, and other author-related methods in the survey) are normal for a survey and for choosing a SoTA representative; they do not force the real-world numbers by construction, and the authors explicitly caveat sensing/mapping/control confounds rather than smuggling uniqueness or ansatz results. No fitted parameter is renamed as a prediction, no uniqueness theorem is imported to forbid alternatives, and no equation reduces to its own input. Score 0 is therefore the correct, proportionate finding.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

As a survey-plus-evaluation paper the central claims rest on standard POMDP formalization of VLN, conventional success thresholds, and the representativeness of two chosen systems and ten scenes. Few free parameters are fitted; the main modeling choices are experimental design decisions rather than invented physical entities.

free parameters (3)

success distance threshold d_th = 3 m
Fixed at the conventional 3 m used by R2R/VLN-CE; directly determines SR/SSR counts.
instruction mix ratios = 70/20/10
70% step-by-step / 20% intention / 10% backtracking chosen by the authors for the real-world suite.
camera height and robot footprint = 1.5 m
Default 1.5 m tripod height and differential-drive chassis geometry affect both perception and collision statistics.

assumptions (3)

domain assumption VLN can be formalized as a POMDP with observation function over egocentric RGB(-D) and language instruction I.
Stated in Sec. II-B; standard in the field since Anderson et al. 2018.
ad hoc to paper The two selected systems (CLASH hierarchical, JanusVLN monolithic) are sufficiently representative of their respective paradigms for comparative claims under the tested stacks.
Sec. V-A; authors note the entanglement of sensing and architecture.
domain assumption A 3 m Euclidean threshold plus human semantic judgment defines success in real scenes.
Sec. V-A metrics; inherits the community convention while adding SSR.

how reviews work

0 comments

Cite this review

Pith. "Pith review of A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation." pith.science (2026). https://pith.science/paper/GBH3EJZG

@misc{pith2026260709792,
  author       = {Pith},
  title        = {Pith review of: A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GBH3EJZG}},
  note         = {Machine review of arXiv:2607.09792}
}

read the original abstract

Navigation is a fundamental capability of autonomous systems, yet most existing approaches rely on highly structured models and strong prior assumptions, limiting their robustness in open and uncertain real-world environments. Vision-and-Language Navigation (VLN) offers a promising direction by enabling robots to integrate natural language understanding with visual perception in a data-driven manner. Although VLN has attracted increasing research attention, systematic methodological taxonomy and real-world validation remain limited. This survey presents a comprehensive review of VLN research. Specifically, state-of-the-art methods are organized along two orthogonal dimensions: action paradigms, including hierarchical and monolithic frameworks, and model paradigms, including discriminative and generative approaches. A critical analysis of their respective strengths and limitations is provided. Additionally, we conduct a systematic real-world evaluation of representative VLN system configurations on a physical robotic platform. Experiments across ten diverse real-world scenes show a substantial performance gap between simulation and real-world deployment under the tested configurations: a representative monolithic RGB-only method achieves 61% success in simulation but drops to 22% in real-world deployment, while a hierarchical framework achieves a higher real-world success rate of 51%, suggesting stronger robustness in our evaluation setting. Finally, we highlight key challenges in perception, decision-making, and control that must be addressed in future research.

Figures

Figures reproduced from arXiv: 2607.09792 by the authors.

**Figure 2.** Trend of vision-and-language navigation (VLN) publications from [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗

**Figure 3.** Overview of this survey. First, the origins of VLN are traced, followed by the problem definition and paradigm classification. Hierarchical and monolithic [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗

Figures from the paper (17 more)

**Figure 4.** Figure 4: Timeline of representative VLN methods categorized by action space and model paradigm. The four quadrants correspond to different combinations [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]

**Figure 5.** Figure 5: Performance trends of representative VLN methods on the validation unseen splits of R2R [5] and R2R-CE [8], measured by SR and SPL. [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]

**Figure 6.** Figure 6: Comparison of different VLN action paradigms. [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]

**Figure 7.** Figure 7: The structure of the hierarchical framework section. [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]

**Figure 8.** Figure 8: Representative VLN methods under the waypoint-based hierarchical framework. (1) Topological graph-based policies incrementally construct an online [PITH_FULL_IMAGE:figures/full_fig_p009_8.png]

**Figure 9.** Figure 9: Additionally, the representative VLN methods under [PITH_FULL_IMAGE:figures/full_fig_p013_9.png]

**Figure 10.** Figure 10: Representative VLN methods under the monolithic action-based framework. (1) Recurrent policies employ recurrent neural networks to encode [PITH_FULL_IMAGE:figures/full_fig_p014_10.png]

**Figure 11.** Figure 11: The used wheeled robot for the real-world evaluation. [PITH_FULL_IMAGE:figures/full_fig_p018_11.png]

**Figure 12.** Figure 12: Real-world scenes for evaluation of vision-and-language navigation, including 10 different environments. [PITH_FULL_IMAGE:figures/full_fig_p019_12.png]

**Figure 15.** Figure 15 [PITH_FULL_IMAGE:figures/full_fig_p019_15.png]

**Figure 14.** Figure 14: Comparison of the first-person visual observations between simula [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]

**Figure 17.** Figure 17: Comparison of the performance of the hierarchical and monolithic [PITH_FULL_IMAGE:figures/full_fig_p020_17.png]

**Figure 16.** Figure 16: Comparison of the performance of the hierarchical and monolithic [PITH_FULL_IMAGE:figures/full_fig_p020_16.png]

**Figure 18.** Figure 18: Comparison of the model inference time and the average step length [PITH_FULL_IMAGE:figures/full_fig_p021_18.png]

**Figure 19.** Figure 19: Examples of real-world navigation trajectories produced by hierarchical and monolithic VLN frameworks [PITH_FULL_IMAGE:figures/full_fig_p022_19.png]

**Figure 20.** Figure 20: Examples of collision failure cases in the real-world evaluation. [PITH_FULL_IMAGE:figures/full_fig_p022_20.png]

**Figure 22.** Figure 22: The long-term evolution trends of VLN research. [PITH_FULL_IMAGE:figures/full_fig_p024_22.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

282 extracted references · 28 linked inside Pith

[1]

On the representation and estimation of spatial uncertainty,

R. C. Smith and P. Cheeseman, “On the representation and estimation of spatial uncertainty,”The International Journal of Robotics Research, vol. 5, no. 4, pp. 56–68, 1986. [Online]. Available: https://doi.org/10.1177/027836498600500404

doi:10.1177/027836498600500404 1986
[2]

Smith, M

R. Smith, M. Self, and P. Cheeseman,Estimating Uncertain Spatial Relationships in Robotics. New York, NY: Springer New York, 1990, pp. 167–193. [Online]. Available: https://doi.org/10.1007/ 978-1-4613-8997-2 14

1990
[3]

Visual odometry,

D. Nister, O. Naroditsky, and J. Bergen, “Visual odometry,” inPro- ceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., vol. 1, 2004, pp. I–I

2004
[4]

Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,

R. Mur-Artal and J. D. Tard ´os, “Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,”IEEE Transactions on Robotics, vol. 33, no. 5, pp. 1255–1262, 2017

2017
[5]

Vision-and-language navigation: Interpret- ing visually-grounded navigation instructions in real environments,

P. Anderson, Q. Wu,et al., “Vision-and-language navigation: Interpret- ing visually-grounded navigation instructions in real environments,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 3674–3683

2018
[6]

Stay on the path: Instruction fidelity in vision-and-language navigation,

V . Jain, G. Magalhaes,et al., “Stay on the path: Instruction fidelity in vision-and-language navigation,” inProceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, pp. 1862–1872

2019
[7]

Room-across-room: Multilingual vision- and-language navigation with dense spatiotemporal grounding,

A. Ku, P. Anderson,et al., “Room-across-room: Multilingual vision- and-language navigation with dense spatiotemporal grounding,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 4392–4412

2020
[8]

Beyond the nav-graph: Vision-and- language navigation in continuous environments,

J. Krantz, E. Wijmans,et al., “Beyond the nav-graph: Vision-and- language navigation in continuous environments,” inComputer Vision – ECCV 2020, A. Vedaldi, H. Bischof,et al., Eds. Springer International Publishing, pp. 104–120. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 25

2020

Show all 282 references

[9]

Towards long-horizon vision-language navigation: Platform, benchmark and method,

X. Song, W. Chen,et al., “Towards long-horizon vision-language navigation: Platform, benchmark and method,” inProceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 12 078–12 088

2025
[10]

Habitat 2.0: Training home assistants to rearrange their habitat,

A. Szot, A. Clegg,et al., “Habitat 2.0: Training home assistants to rearrange their habitat,”Advances in neural information processing systems, vol. 34, pp. 251–266, 2021

2021
[11]

Ai2-thor: An interactive 3d environment for visual ai,

E. Kolve, R. Mottaghi,et al., “Ai2-thor: An interactive 3d environment for visual ai,” inarXiv preprint arXiv:1712.05474, 2017

2017 arXiv
[12]

Behavior-1k: A human-centered, embodied ai benchmark with 1, 000 everyday activities and realistic simulation,

C. Li, R. Zhang,et al., “Behavior-1k: A human-centered, embodied ai benchmark with 1, 000 everyday activities and realistic simulation,” CoRR, 2024

2024
[13]

Rethinking the embodied gap in vision- and-language navigation: A holistic study of physical and visual disparities,

L. Wang, X. Xia,et al., “Rethinking the embodied gap in vision- and-language navigation: A holistic study of physical and visual disparities,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2025, pp. 9455–9465

2025
[14]

Speaker-follower models for vision-and- language navigation,

D. Fried, R. Hu,et al., “Speaker-follower models for vision-and- language navigation,”Advances in Neural Information Processing Systems, vol. 31, 2018

2018
[15]

Learning to navigate unseen environ- ments: Back translation with environmental dropout,

H. Tan, L. Yu, and M. Bansal, “Learning to navigate unseen environ- ments: Back translation with environmental dropout,” inProceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (...

2019
[16]

Vln bert: A recurrent vision-and-language bert for navigation,

Y . Hong, Q. Wu,et al., “Vln bert: A recurrent vision-and-language bert for navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 1643–1653

2021
[17]

Think global, act local: Dual-scale graph transformer for vision-and-language navigation,

S. Chen, P.-L. Guhur,et al., “Think global, act local: Dual-scale graph transformer for vision-and-language navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16 537–16 547

2022
[18]

g3d-lf: Generalizable 3d-language feature fields for embodied tasks,

Z. Wang and G. H. Lee, “g3d-lf: Generalizable 3d-language feature fields for embodied tasks,” inProceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 14 191–14 202

2025
[19]

Vln-r1: Vision-language navigation via reinforcement fine-tuning,

Z. Qi, Z. Zhang,et al., “Vln-r1: Vision-language navigation via reinforcement fine-tuning,”arXiv preprint arXiv:2506.17221, 2025

2025 arXiv
[20]

Source-free elastic model adaptation for vision-and-language navigation,

M. Tan, P. Chen,et al., “Source-free elastic model adaptation for vision-and-language navigation,”IEEE Transactions on Multimedia, vol. 27, pp. 3953–3965, 2025

2025
[21]

Navq: Learning a q-model for foresighted vision-and-language navigation,

P. Xu, X. Gong, and Y . Mu, “Navq: Learning a q-model for foresighted vision-and-language navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2025, pp. 6327–6341

2025
[22]

Navid: Video-based vlm plans the next step for vision-and-language navigation,

J. Zhang, K. Wang,et al., “Navid: Video-based vlm plans the next step for vision-and-language navigation,”Robotics: Science and Systems, 2024

2024
[23]

Uni-navid: A video-based vision-language- action model for unifying embodied navigation tasks,

J. Zhang, K. Wang,et al., “Uni-navid: A video-based vision-language- action model for unifying embodied navigation tasks,”Robotics: Sci- ence and Systems, 2025

2025
[24]

Navila: Legged robot vision-language-action model for navigation,

A.-C. Cheng, Y . Ji,et al., “Navila: Legged robot vision-language-action model for navigation,” inRSS, 2025

2025
[25]

Streamvln: Streaming vision-and- language navigation via slowfast context modeling,

M. Wei, C. Wan,et al., “Streamvln: Streaming vision-and- language navigation via slowfast context modeling,”arXiv preprint arXiv:2507.05240, 2025

2025 arXiv
[26]

Clash: Collaborative large-small hierarchi- cal framework for continuous vision-and-language navigation,

L. Wang, Z. He,et al., “Clash: Collaborative large-small hierarchi- cal framework for continuous vision-and-language navigation,”arXiv preprint arXiv:2512.10360, 2025

2025
[27]

Janusvln: Decoupling semantics and spatiality with dual implicit memory for vision-language navigation,

S. Zeng, D. Qi,et al., “Janusvln: Decoupling semantics and spatiality with dual implicit memory for vision-language navigation,” inPro- ceedings of the International Conference on Learning Representations (ICLR), 2026

2026
[28]

Bootstrapping language-guided navigation learn- ing with self-refining data flywheel,

Z. Wang, J. Li,et al., “Bootstrapping language-guided navigation learn- ing with self-refining data flywheel,” inThe Thirteenth International Conference on Learning Representations, 2024

2024
[29]

Waypoint models for instruction- guided navigation in continuous environments,

J. Krantz, A. Gokaslan,et al., “Waypoint models for instruction- guided navigation in continuous environments,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 15 162–15 171

2021
[30]

Etpnav: Evolving topological planning for vision-language navigation in continuous environments,

D. An, H. Wang,et al., “Etpnav: Evolving topological planning for vision-language navigation in continuous environments,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

2024
[31]

Internvla-n1: An open dual-system vision-language navigation foundation model with learned latent plans,

I.-N. Team, “Internvla-n1: An open dual-system vision-language navigation foundation model with learned latent plans,” Technical report, Shanghai AI Laboratory, 2025. [Online]. Available: https://internrobotics.github.io/internvla-n1.github.io/static/ pdfs/InternVLA N1.pdf

2025
[32]

Multimodal evolutionary encoder for con- tinuous vision-language navigation,

Z. He, L. Wang,et al., “Multimodal evolutionary encoder for con- tinuous vision-language navigation,” in2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct. 2024, pp. 1443–1450

2024
[33]

Language-aligned waypoint (law) supervision for vision-and-language navigation in continuous environ- ments,

S. Raychaudhuri, S. Wani,et al., “Language-aligned waypoint (law) supervision for vision-and-language navigation in continuous environ- ments,” inProceedings of the 2021 conference on empirical methods in natural language processing, 2021, pp. 4018–4028

2021
[34]

Navgpt: Explicit reasoning in vision- and-language navigation with large language models,

G. Zhou, Y . Hong, and Q. Wu, “Navgpt: Explicit reasoning in vision- and-language navigation with large language models,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 7, 2024, pp. 7641–7649

2024
[35]

Navcot: Boosting llm-based vision-and-language navigation via learning disentangled reasoning,

B. Lin, Y . Nie,et al., “Navcot: Boosting llm-based vision-and-language navigation via learning disentangled reasoning,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025

2025
[36]

Dynam3d: Dynamic layered 3d tokens empower vlm for vision-and-language navigation,

Z. Wang, S. Lee, and G. H. Lee, “Dynam3d: Dynamic layered 3d tokens empower vlm for vision-and-language navigation,” inAdvances in Neural Information Processing Systems, 2025

2025
[37]

History aware multimodal transformer for vision-and-language navigation,

S. Chen, P.-L. Guhur,et al., “History aware multimodal transformer for vision-and-language navigation,”Advances in Neural Information Processing Systems, vol. 34, 2021

2021
[38]

Vision-and-language navigation via causal learning,

L. Wang, J. Tang,et al., “Vision-and-language navigation via causal learning,”Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2024
[39]

Lookahead exploration with neural radiance representation for continuous vision-language navigation,

Z. Wang, X. Li,et al., “Lookahead exploration with neural radiance representation for continuous vision-language navigation,” inProceed- ings of the IEEE/CVF conference on computer vision and pattern recognition, 2024, pp. 13 753–13 762

2024
[40]

Learning depth representation from rgb-d videos by time-aware contrastive pre-training,

Z. He, L. Wang,et al., “Learning depth representation from rgb-d videos by time-aware contrastive pre-training,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 6, pp. 4143– 4158, 2023

2023
[41]

Chatgpt: Optimizing language models for dialogue,

OpenAI, “Chatgpt: Optimizing language models for dialogue,” https: //openai.com/blog/chatgpt, 2022

2022
[42]

Qwen2.5-vl technical report,

S. Bai, K. Chen,et al., “Qwen2.5-vl technical report,”arXiv preprint arXiv:2502.13923, 2025

2025 arXiv
[43]

Internvl: Scaling up vision foundation models and aligning for generic visual-linguistic tasks,

Z. Chen, J. Wu,et al., “Internvl: Scaling up vision foundation models and aligning for generic visual-linguistic tasks,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 24 185–24 198

2024
[44]

Embodied navigation foundation model,

J. Zhang, A. Li,et al., “Embodied navigation foundation model,” in Proceedings of the International Conference on Learning Representa- tions (ICLR), 2026

2026
[45]

Vision-and-language navigation today and tomorrow: A survey in the era of foundation models,

Y . Zhang, Z. Ma,et al., “Vision-and-language navigation today and tomorrow: A survey in the era of foundation models,”Transactions on Machine Learning Research, 2024

2024
[46]

Vision-language navigation with embodied intelligence: A survey,

P. Gao, P. Wang,et al., “Vision-language navigation with embodied intelligence: A survey,”arXiv preprint arXiv:2402.14304, 2024

2024 arXiv
[47]

Advances in embodied navigation using large language models: A survey,

J. Lin, H. Gao,et al., “Advances in embodied navigation using large language models: A survey,”arXiv preprint arXiv:2311.00530, 2023

2023 arXiv
[48]

Safety of embodied navigation: a survey,

Z. Wang, J. Hu, and R. Mu, “Safety of embodied navigation: a survey,” inProceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, 2025, pp. 10 714–10 722

2025
[49]

Aeroverse-review: Comprehensive survey on aerial embodied vision-and-language navigation,

F. Yao, Y . Liu,et al., “Aeroverse-review: Comprehensive survey on aerial embodied vision-and-language navigation,”The Innovation Informatics, vol. 1, no. 1, pp. 100 015–1, 2025

2025
[50]

A survey on vision–language–action models for embodied ai,

Y . Ma, Z. Song,et al., “A survey on vision–language–action models for embodied ai,”IEEE Transactions on Neural Networks and Learning Systems, 2026

2026
[51]

Vision-language-action models for robotics: A review towards real-world applications,

K. Kawaharazuka, J. Oh,et al., “Vision-language-action models for robotics: A review towards real-world applications,”IEEE Access, vol. 13, pp. 162 467–162 504, 2025

2025
[52]

Agentvln: Towards agentic vision-and-language navigation,

Z. Xin, W. Li,et al., “Agentvln: Towards agentic vision-and-language navigation,”arXiv preprint arXiv:2603.17670, 2026

2026
[53]

Affordances-oriented planning using foundation models for continuous vision-language navigation,

J. Chen, B. Lin,et al., “Affordances-oriented planning using foundation models for continuous vision-language navigation,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 22, 2025, pp. 23 568–23 576

2025
[54]

Instructnav: Zero-shot system for generic instruction navigation in unexplored environment,

Y . Long, W. Cai,et al., “Instructnav: Zero-shot system for generic instruction navigation in unexplored environment,” in8th Annual Conference on Robot Learning
[55]

Mapgpt: Map-guided prompting with adaptive path planning for vision-and-language navigation,

J. Chen, B. Lin,et al., “Mapgpt: Map-guided prompting with adaptive path planning for vision-and-language navigation,” inProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024, pp. 9796–9810. JOURNAL OF LATEX CLASS...

2024
[56]

Visual language maps for robot navigation,

C. Huang, O. Mees,et al., “Visual language maps for robot navigation,” inProceedings of the IEEE International Conference on Robotics and Automation (ICRA), London, UK, 2023

2023
[57]

Correctnav: Self-correction flywheel empowers vision-language-action navigation model,

Z. Yu, Y . Long,et al., “Correctnav: Self-correction flywheel empowers vision-language-action navigation model,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 40, no. 22, 2026, pp. 18 737– 18 745

2026
[58]

Omninav: A unified framework for prospective exploration and visual-language navigation,

X. Xue, J. Hu,et al., “Omninav: A unified framework for prospective exploration and visual-language navigation,” inProceedings of the International Conference on Learning Representations (ICLR), 2026

2026
[59]

Astranav-world: World model for foresight control and consistency,

J. Hu, J. Chen,et al., “Astranav-world: World model for foresight control and consistency,”arXiv preprint arXiv:2512.21714, 2025

2025 arXiv
[60]

Decovln: Decoupling observation, reasoning, and correction for vision-and-language navigation,

Z. Xin, W. Li,et al., “Decovln: Decoupling observation, reasoning, and correction for vision-and-language navigation,” 2026. [Online]. Available: https://arxiv.org/abs/2603.13133

2026
[61]

Abot-n0: Technical report on the vla foundation model for versatile embodied navigation,

Z. Chu, S. Xie,et al., “Abot-n0: Technical report on the vla foundation model for versatile embodied navigation,”arXiv preprint arXiv:2602.11598, 2026

2026
[62]

Scaling data generation in vision-and-language navigation,

Z. Wang, J. Li,et al., “Scaling data generation in vision-and-language navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 12 009–12 020

2023
[63]

Envedit: Environment editing for vision- and-language navigation,

J. Li, H. Tan, and M. Bansal, “Envedit: Environment editing for vision- and-language navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 15 407–15 417

2022
[64]

Bevbert: Multimodal map pre-training for language-guided navigation,

D. An, Y . Qi,et al., “Bevbert: Multimodal map pre-training for language-guided navigation,”Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision, 2023

2023
[65]

Towards learning a generic agent for vision-and- language navigation via pre-training,

W. Hao, C. Li,et al., “Towards learning a generic agent for vision-and- language navigation via pre-training,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 13 137–13 146

2020
[66]

Semantically-aware spatio-temporal reasoning agent for vision-and-language navigation in continuous en- vironments,

M. Z. Irshad, N. C. Mithun,et al., “Semantically-aware spatio-temporal reasoning agent for vision-and-language navigation in continuous en- vironments,” in2022 26th International conference on pattern recog- nition (ICPR). IEEE, 2022, pp. 4065–4071

2022
[67]

Cross-modal map learning for vision and language navigation,

G. Georgakis, K. Schmeckpeper,et al., “Cross-modal map learning for vision and language navigation,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 15 460–15 470

2022
[68]

A multilevel attention network with sub- instructions for continuous vision-and-language navigation,

Z. He, L. Wang,et al., “A multilevel attention network with sub- instructions for continuous vision-and-language navigation,”Applied Intelligence, vol. 55, no. 7, p. 657, Apr. 2025

2025
[69]

Singer: An onboard generalist vision- language navigation policy for drones,

M. Adang, J. Low,et al., “Singer: An onboard generalist vision- language navigation policy for drones,” inIROS 2025 Workshop: Open World Navigation in Human-centric Environments

2025
[70]

Qwen-robotnav technical report: A scalable navigation model designed for an agentic navigation system,

J. Zhang, G. Zhou,et al., “Qwen-robotnav technical report: A scalable navigation model designed for an agentic navigation system,”arXiv preprint arXiv:2606.18112, 2026

2026 arXiv
[71]

Vision and navigation for the carnegie- mellon navlab,

C. Thorpe, M. Hebert,et al., “Vision and navigation for the carnegie- mellon navlab,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 3, pp. 362–373, 1988

1988
[72]

A visual navigation system for autonomous land vehicles,

A. Waxman, J. LeMoigne,et al., “A visual navigation system for autonomous land vehicles,”IEEE Journal on Robotics and Automation, vol. 3, no. 2, pp. 124–141, 1987

1987
[73]

An experimental system for incremental environment modelling by an autonomous mobile robot,

P. Moutarlier and R. Chatila, “An experimental system for incremental environment modelling by an autonomous mobile robot,” inThe First International Symposium on Experimental Robotics I, 1989, pp. 327– 346

1989
[74]

Mobile robot localization using a single image,

E. Krotkov, “Mobile robot localization using a single image,” inPro- ceedings, 1989 International Conference on Robotics and Automation, 1989, pp. 978–983 vol.2

1989
[75]

Monoslam: Real-time single camera slam,

A. J. Davison, I. D. Reid,et al., “Monoslam: Real-time single camera slam,”IEEE Transactions on Pattern Analysis and Machine Intelli- gence, vol. 29, no. 6, pp. 1052–1067, 2007

2007
[76]

Parallel tracking and mapping for small ar workspaces,

G. Klein and D. Murray, “Parallel tracking and mapping for small ar workspaces,” in2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 2007, pp. 225–234

2007
[77]

Lsd-slam: Large-scale direct monocular slam,

J. Engel, T. Sch ¨ops, and D. Cremers, “Lsd-slam: Large-scale direct monocular slam,” inComputer Vision – ECCV 2014, D. Fleet, T. Pajdla, et al., Eds. Cham: Springer International Publishing, 2014, pp. 834– 849

2014
[78]

Deepvo: Towards end-to-end visual odom- etry with deep recurrent convolutional neural networks,

S. Wang, R. Clark,et al., “Deepvo: Towards end-to-end visual odom- etry with deep recurrent convolutional neural networks,” in2017 IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 2043–2050

2017
[79]

Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras,

Z. Teed and J. Deng, “Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras,” inAdvances in Neural Information Pro- cessing Systems, M. Ranzato, A. Beygelzimer,et al., Eds., vol. 34. Curran Associates, Inc., 2021, pp. 16 558–16 569

2021
[80]

Dd-ppo: Learning near-perfect point- goal navigators from 2.5 billion frames,

E. Wijmans, A. Kadian,et al., “Dd-ppo: Learning near-perfect point- goal navigators from 2.5 billion frames,” inInternational Conference on Learning Representations
[81]

Target-driven visual navigation in indoor scenes using deep reinforcement learning,

Y . Zhu, R. Mottaghi,et al., “Target-driven visual navigation in indoor scenes using deep reinforcement learning,” in2017 IEEE international conference on robotics and automation (ICRA). IEEE, 2017, pp. 3357– 3364

2017
[82]

Object goal navigation using goal-oriented semantic exploration,

D. S. Chaplot, D. P. Gandhi,et al., “Object goal navigation using goal-oriented semantic exploration,”Advances in Neural Information Processing Systems, vol. 33, pp. 4247–4258, 2020

2020
[83]

Reverie: Remote embodied visual referring ex- pression in real indoor environments,

Y . Qi, Q. Wu,et al., “Reverie: Remote embodied visual referring ex- pression in real indoor environments,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 9982–9991

2020
[84]

Executing instructions in situated collaborative interactions,

A. Suhr, C. Yan,et al., “Executing instructions in situated collaborative interactions,” inProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, pp....

2019
[85]

Mapping instructions to actions in 3d environments with visual goal prediction,

D. Misra, A. Bennett,et al., “Mapping instructions to actions in 3d environments with visual goal prediction,” inProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp. 2667–2678

2018
[86]

Vision-and-dialog navigation,

J. Thomason, M. Murray,et al., “Vision-and-dialog navigation,” in Conference on Robot Learning. PMLR, 2020, pp. 394–406

2020
[87]

Embodied question answering,

A. Das, S. Datta,et al., “Embodied question answering,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 1–10

2018
[88]

Help, anna! visual navigation with natural multimodal assistance via retrospective curiosity-encouraging imitation learning,

K. Nguyen and H. Daum ´e III, “Help, anna! visual navigation with natural multimodal assistance via retrospective curiosity-encouraging imitation learning,” inProceedings of the 2019 Conference on Empiri- cal Methods in Natural Language Processing and the 9th International Joi...

2019
[89]

Just ask: An interactive learning framework for vision and language navigation,

T.-C. Chi, M. Shen,et al., “Just ask: An interactive learning framework for vision and language navigation,” inProceedings of the AAAI conference on artificial intelligence, vol. 34, no. 03, 2020, pp. 2459– 2466

2020
[90]

Landmark-rxr: Solving vision-and-language navigation with fine-grained alignment supervision,

K. He, Y . Huang,et al., “Landmark-rxr: Solving vision-and-language navigation with fine-grained alignment supervision,”Advances in Neu- ral Information Processing Systems, vol. 34, pp. 652–663, 2021

2021
[91]

Building generalizable agents with a realistic and rich 3d environment,

Y . Wu, Y . Wu,et al., “Building generalizable agents with a realistic and rich 3d environment,”arXiv preprint arXiv:1801.02209, 2018

2018 arXiv
[92]

Soon: Scenario oriented object navigation with graph-based exploration,

F. Zhu, X. Liang,et al., “Soon: Scenario oriented object navigation with graph-based exploration,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021, pp. 12 689–12 699

2021
[93]

Vision-based navigation with language- based assistance via imitation learning with indirect intervention,

K. Nguyen, D. Dey,et al., “Vision-based navigation with language- based assistance via imitation learning with indirect intervention,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 12 527–12 537

2019
[94]

Cross-lingual vision-language navigation,

A. Yan, X. E. Wang,et al., “Cross-lingual vision-language navigation,” arXiv preprint arXiv:1910.11301, 2019

1910 arXiv
[95]

Iqa: Visual question answering in interactive environments,

D. Gordon, A. Kembhavi,et al., “Iqa: Visual question answering in interactive environments,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 4089–4098

2018
[96]

Alfred: A benchmark for interpreting grounded instructions for everyday tasks,

M. Shridhar, J. Thomason,et al., “Alfred: A benchmark for interpreting grounded instructions for everyday tasks,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 10 740–10 749

2020
[97]

Hierarchical cross-modal agent for robotics vision-and-language navigation,

M. Z. Irshad, C.-Y . Ma, and Z. Kira, “Hierarchical cross-modal agent for robotics vision-and-language navigation,” in2021 IEEE interna- tional conference on robotics and automation (ICRA). IEEE, 2021, pp. 13 238–13 246

2021
[98]

Teach: Task-driven embodied agents that chat,

A. Padmakumar, J. Thomason,et al., “Teach: Task-driven embodied agents that chat,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 2, 2022, pp. 2017–2025

2022
[99]

Reve-ce: Remote embodied visual referring expression in continuous environment,

X. Li, D. Guo,et al., “Reve-ce: Remote embodied visual referring expression in continuous environment,”IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 1494–1501, 2022

2022
[100]

Dialfred: Dialogue-enabled agents for em- bodied instruction following,

X. Gao, Q. Gao,et al., “Dialfred: Dialogue-enabled agents for em- bodied instruction following,”IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10 049–10 056, 2022. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 27

2022
[101]

Iterative vision-and-language naviga- tion,

J. Krantz, S. Banerjee,et al., “Iterative vision-and-language naviga- tion,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 14 921–14 930

2023
[102]

Goat-bench: A benchmark for multi-modal lifelong navigation,

M. Khanna, R. Ramrakhya,et al., “Goat-bench: A benchmark for multi-modal lifelong navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 16 373–16 383

2024
[103]

Vlnverse: A benchmark for vision- language navigation with versatile, embodied, realistic simulation and evaluation,

S. Lin, Z. Li,et al., “Vlnverse: A benchmark for vision- language navigation with versatile, embodied, realistic simulation and evaluation,” 2025. [Online]. Available: https://arxiv.org/abs/2512.19021

2025
[104]

Aerial vision-and-dialog navigation,

Y . Fan, W. Chen,et al., “Aerial vision-and-dialog navigation,” in Findings of the Association for Computational Linguistics: ACL 2023, 2023, pp. 3043–3061

2023
[105]

Aerialvln: Vision-and-language navigation for uavs,

S. Liu, H. Zhang,et al., “Aerialvln: Vision-and-language navigation for uavs,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 15 384–15 394

2023
[106]

Conditional driving from natural language instructions,

J. Roh, C. Paxton,et al., “Conditional driving from natural language instructions,” inConference on Robot Learning. PMLR, 2020, pp. 540–551

2020
[107]

Talk to the vehicle: Language conditioned autonomous navigation of self driving cars,

N. Sriram, T. Maniar,et al., “Talk to the vehicle: Language conditioned autonomous navigation of self driving cars,” in2019 IEEE/RSJ inter- national conference on intelligent robots and systems (IROS). IEEE, 2019, pp. 5284–5290

2019
[108]

Grutopia: Dream general robots in a city at scale,

H. Wang, J. Chen,et al., “Grutopia: Dream general robots in a city at scale,”arXiv preprint arXiv:2407.10943, 2024

2024 arXiv
[109]

Collaborative dialogue in minecraft,

A. Narayan-Chen, P. Jayannavar, and J. Hockenmaier, “Collaborative dialogue in minecraft,” inProceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, pp. 5405–5415

2019
[110]

The robotslang benchmark: Dialog-guided robot localization and navigation,

S. Banerjee, J. Thomason, and J. Corso, “The robotslang benchmark: Dialog-guided robot localization and navigation,” inConference on Robot Learning. PMLR, 2021, pp. 1384–1393

2021
[111]

DOROTHIE: Spoken dialogue for handling unexpected situations in interactive autonomous driving agents,

Z. Ma, B. VanDerPloeg,et al., “DOROTHIE: Spoken dialogue for handling unexpected situations in interactive autonomous driving agents,” inFindings of the Association for Computational Linguistics: EMNLP 2022. Abu Dhabi, United Arab Emirates: Association for Computational Lingui...

2022
[112]

The streetlearn environment and dataset,

P. Mirowski, A. Banki-Horvath,et al., “The streetlearn environment and dataset,”arXiv preprint arXiv:1903.01292, 2019

1903 arXiv
[113]

Learning to follow directions in street view,

K. M. Hermann, M. Malinowski,et al., “Learning to follow directions in street view,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, 2020, pp. 11 773–11 780. [Online]. Available: https://ojs.aaai.org/index.php/AAAI/article/view/6849

2020
[114]

Talk the walk: Navigating new york city through grounded dialogue,

H. De Vries, K. Shuster,et al., “Talk the walk: Navigating new york city through grounded dialogue,”arXiv preprint arXiv:1807.03367, 2018

2018 arXiv
[115]

Talk2nav: Long-range vision-and-language navigation with dual attention and spatial mem- ory,

A. B. Vasudevan, D. Dai, and L. Van Gool, “Talk2nav: Long-range vision-and-language navigation with dual attention and spatial mem- ory,”International Journal of Computer Vision, vol. 129, no. 1, pp. 246–266, 2021

2021
[116]

Touchdown: Natural language navigation and spatial reasoning in visual street environments,

H. Chen, A. Suhr,et al., “Touchdown: Natural language navigation and spatial reasoning in visual street environments,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 12 538–12 547

2019
[117]

Habitat: A platform for embodied ai research,

M. Savva, A. Kadian,et al., “Habitat: A platform for embodied ai research,” inProceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 9339–9347

2019
[118]

On evaluation of embodied navigation agents,

P. Anderson, A. Chang,et al., “On evaluation of embodied navigation agents,”arXiv preprint arXiv:1807.06757, 2018

2018 arXiv
[119]

Habitat 3.0: A co-habitat for humans,

X. Puig, E. Undersander,et al., “Habitat 3.0: A co-habitat for humans,” Avatars and Robots, vol. 4, 2023

2023
[120]

Interactive gibson benchmark: A bench- mark for interactive navigation in cluttered environments,

F. Xia, A. R. Zamir,et al., “Interactive gibson benchmark: A bench- mark for interactive navigation in cluttered environments,” inProceed- ings of the IEEE International Conference on Robotics and Automation (ICRA), 2020

2020
[121]

igibson 1.0: a simulation environment for inter- active tasks in large realistic scenes,

B. Shen, F. Xia,et al., “igibson 1.0: a simulation environment for inter- active tasks in large realistic scenes,” in2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, p. accepted

2021
[122]

igibson 2.0: Object-centric simulation for robot learning of everyday household tasks,

C. Li, F. Xia,et al., “igibson 2.0: Object-centric simulation for robot learning of everyday household tasks,” inProceedings of the 5th Conference on Robot Learning, ser. Proceedings of Machine Learning Research, A. Faust, D. Hsu, and G. Neumann, Eds., vol. 164. PMLR, 08–11 No...

2022
[123]

Behavior: Benchmark for everyday house- hold activities in virtual, interactive, and ecological environments,

S. Srivastava, C. Li,et al., “Behavior: Benchmark for everyday house- hold activities in virtual, interactive, and ecological environments,” in Conference on robot learning. PMLR, 2022, pp. 477–490

2022
[124]

Procthor: Large-scale embodied ai using procedural generation,

M. Deitke, E. VanderBilt,et al., “Procthor: Large-scale embodied ai using procedural generation,”Advances in Neural Information Process- ing Systems, vol. 35, pp. 5982–5994, 2022

2022
[125]

Manipulathor: A framework for visual object manipulation,

K. Ehsani, W. Han,et al., “Manipulathor: A framework for visual object manipulation,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 4497–4506

2021
[126]

Robothor: An open simulation-to-real embodied ai platform,

M. Deitke, W. Han,et al., “Robothor: An open simulation-to-real embodied ai platform,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 3164–3174

2020
[127]

Carla: An open urban driving simula- tor,

A. Dosovitskiy, G. Ros,et al., “Carla: An open urban driving simula- tor,” inProceedings of the 1st Annual Conference on Robot Learning (CoRL), 2017, pp. 1–16

2017
[128]

Think2drive: Efficient reinforcement learning by thinking with latent world model for autonomous driving (in carla- v2),

Q. Li, X. Jia,et al., “Think2drive: Efficient reinforcement learning by thinking with latent world model for autonomous driving (in carla- v2),” inEuropean Conference on Computer Vision. Springer, 2024, pp. 142–158

2024
[129]

Drivelm: Driving with graph visual question answering,

C. Sima, K. Renz,et al., “Drivelm: Driving with graph visual question answering,” inEuropean conference on computer vision. Springer, 2024, pp. 256–274

2024
[130]

General evaluation for instruction conditioned navigation using dynamic time warping,

G. I. Magalhaes, V . Jain,et al., “General evaluation for instruction conditioned navigation using dynamic time warping,” inNeurIPS Visually Grounded Interaction and Language (ViGIL) Workshop, vol. 1, 2019

2019
[131]

Ground slow, move fast: A dual-system foundation model for generalizable vision-and-language navigation,

M. Wei, C. Wan,et al., “Ground slow, move fast: A dual-system foundation model for generalizable vision-and-language navigation,” inProceedings of the International Conference on Learning Represen- tations (ICLR), 2026

2026
[132]

Nomad: Goal masked diffusion policies for navigation and exploration,

A. Sridhar, D. Shah,et al., “Nomad: Goal masked diffusion policies for navigation and exploration,” in2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024, pp. 63–70

2024
[133]

Diffusion policy: Visuomotor policy learning via action diffusion,

C. Chi, Z. Xu,et al., “Diffusion policy: Visuomotor policy learning via action diffusion,”The International Journal of Robotics Research, p. 02783649241273668, 2023

2023
[134]

Bird’s-eye-view scene graph for vision- language navigation,

R. Liu, X. Wang,et al., “Bird’s-eye-view scene graph for vision- language navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 10 968–10 980

2023
[135]

Gridmm: Grid memory map for vision-and- language navigation,

Z. Wang, X. Li,et al., “Gridmm: Grid memory map for vision-and- language navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 15 625–15 636

2023
[136]

Convoi: Context-aware navigation using vision language models in outdoor and indoor envi- ronments,

A. J. Sathyamoorthy, K. Weerakoon,et al., “Convoi: Context-aware navigation using vision language models in outdoor and indoor envi- ronments,” in2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2024, pp. 13 837–13 844

2024
[137]

Deep residual learning for image recognition,

K. He, X. Zhang,et al., “Deep residual learning for image recognition,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778

2016
[138]

Long short-term memory,

S. Hochreiter and J. Schmidhuber, “Long short-term memory,”Neural computation, vol. 9, no. 8, pp. 1735–1780, 1997

1997
[139]

Multi-modal discriminative model for vision- and-language navigation,

H. Huang, V . Jain,et al., “Multi-modal discriminative model for vision- and-language navigation,” inProceedings of the Combined Workshop on Spatial Language Understanding (SpLU) and Grounded Communi- cation for Robotics (RoboNLP), 2019, pp. 40–49

2019
[140]

Are you looking? grounding to multiple modalities in vision-and-language navigation,

R. Hu, D. Fried,et al., “Are you looking? grounding to multiple modalities in vision-and-language navigation,” inProceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, pp. 6551–6557

2019
[141]

Attention is all you need,

A. Vaswani, N. Shazeer,et al., “Attention is all you need,” inAdvances in neural information processing systems, 2017, pp. 5998–6008

2017
[142]

Lxmert: Learning cross-modality encoder representations from transformers,

H. Tan and M. Bansal, “Lxmert: Learning cross-modality encoder representations from transformers,” inProceedings of the 2019 Confer- ence on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP...

2019
[143]

Crossmap transformer: A crossmodal masked path transformer using double back-translation for vision-and-language navigation,

A. Magassouba, K. Sugiura, and H. Kawai, “Crossmap transformer: A crossmodal masked path transformer using double back-translation for vision-and-language navigation,”IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 6258–6265, 2021

2021
[144]

Bridging the gap between learning in discrete and continuous environments for vision-and-language navigation,

Y . Hong, Z. Wang,et al., “Bridging the gap between learning in discrete and continuous environments for vision-and-language navigation,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 15 439–15 449

2022
[145]

Unbiased directed object attention graph for object navigation,

R. Dang, Z. Shi,et al., “Unbiased directed object attention graph for object navigation,” inProceedings of the 30th ACM International Conference on Multimedia, ser. MM ’22. New York, NY , USA: Association for Computing Machinery, 2022, p. 3617–3627. JOURNAL OF LATEX CLASS FILE...

2022
[146]

Search for or navigate to? dual adaptive thinking for object navigation,

R. Dang, L. Wang,et al., “Search for or navigate to? dual adaptive thinking for object navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 8250–8259

2023
[147]

The road to know-where: An object-and-room informed sequential bert for indoor vision-language navigation,

Y . Qi, Z. Pan,et al., “The road to know-where: An object-and-room informed sequential bert for indoor vision-language navigation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 1655–1664

2021
[148]

Soat: A scene-and object-aware transformer for vision-and-language navigation,

A. Moudgil, A. Majumdar,et al., “Soat: A scene-and object-aware transformer for vision-and-language navigation,”Advances in Neural Information Processing Systems, vol. 34, pp. 7357–7367, 2021

2021
[149]

Diagnosing the environment bias in vision-and-language navigation,

Y . Zhang, H. Tan, and M. Bansal, “Diagnosing the environment bias in vision-and-language navigation,” inProceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, ser. IJCAI’20, 2021

2021
[150]

Reinforced structured state-evolution for vision-language navigation,

J. Chen, C. Gao,et al., “Reinforced structured state-evolution for vision-language navigation,” inProceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, 2022, pp. 15 450– 15 459

2022
[151]

Object-and-action aware model for visual language navigation,

Y . Qi, Z. Pan,et al., “Object-and-action aware model for visual language navigation,” inComputer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part X

2020
[152]

Springer, 2020, pp. 303–317

2020
[153]

Neighbor-view enhanced model for vision and language navigation,

D. An, Y . Qi,et al., “Neighbor-view enhanced model for vision and language navigation,” inProceedings of the 29th ACM International Conference on Multimedia, 2021, pp. 5101–5109

2021
[154]

Adapt: Vision-language navigation with modality-aligned action prompts,

B. Lin, Y . Zhu,et al., “Adapt: Vision-language navigation with modality-aligned action prompts,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 15 396–15 406

2022
[155]

Learning transferable visual models from natural language supervision,

A. Radford, J. W. Kim,et al., “Learning transferable visual models from natural language supervision,” inInternational conference on machine learning. PmLR, 2021, pp. 8748–8763

2021
[156]

A dual semantic-aware recurrent global- adaptive network for vision-and-language navigation,

L. Wang, Z. He,et al., “A dual semantic-aware recurrent global- adaptive network for vision-and-language navigation,” inInternational Joint Conferences on Artificial Intelligence (IJCAI), 2023

2023
[157]

Hierarchical semantic-augmented navigation: Optimal transport and graph-driven reasoning for vision- language navigation,

X. Fang, W. Fang, and C. Wang, “Hierarchical semantic-augmented navigation: Optimal transport and graph-driven reasoning for vision- language navigation,” inThe Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025

2025
[158]

Sub-instruction aware vision-and- language navigation,

Y . Hong, C. Rodriguez,et al., “Sub-instruction aware vision-and- language navigation,” inProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 3360–3376

2020
[159]

Grounded entity-landmark adaptive pre-training for vision-and-language navigation,

Y . Cui, L. Xie,et al., “Grounded entity-landmark adaptive pre-training for vision-and-language navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 12 043– 12 053

2023
[160]

How much can clip benefit vision-and- language tasks?

S. Shen, L. H. Li,et al., “How much can clip benefit vision-and- language tasks?” inInternational Conference on Learning Representa- tions
[161]

Clip-nav: Using clip for zero- shot vision-and-language navigation,

V . S. Dorbala, G. A. Sigurdsson,et al., “Clip-nav: Using clip for zero- shot vision-and-language navigation,” inWorkshop on Language and Robotics at CoRL 2022

2022
[162]

Contrastive instruction-trajectory learning for vision-language navigation,

X. Liang, F. Zhu,et al., “Contrastive instruction-trajectory learning for vision-language navigation,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 2, 2022, pp. 1592–1600

2022
[163]

Enhanced language-guided robot navigation with panoramic semantic depth perception and cross-modal fusion,

L. Wang, J. Tang,et al., “Enhanced language-guided robot navigation with panoramic semantic depth perception and cross-modal fusion,” in2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2024, pp. 7726–7733

2024
[164]

Multiple visual features in topological map for vision-and-language navigation,

R. Liu, P. Kong, and W. Zhang, “Multiple visual features in topological map for vision-and-language navigation,” in2024 IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems (IROS). IEEE, 2024, pp. 7742–7749

2024
[165]

Geovln: Learning geometry-enhanced visual representation with slot attention for vision-and-language navigation,

J. Huo, Q. Sun,et al., “Geovln: Learning geometry-enhanced visual representation with slot attention for vision-and-language navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 23 212–23 221

2023
[166]

Depth-guided adain and shift attention net- work for vision-and-language navigation,

Q. Sun, Y . Zhuang,et al., “Depth-guided adain and shift attention net- work for vision-and-language navigation,” in2021 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2021, pp. 1–6

2021
[167]

Counterfactual vision-and- language navigation: Unravelling the unseen,

A. Parvaneh, E. Abbasnejad,et al., “Counterfactual vision-and- language navigation: Unravelling the unseen,”Advances in Neural Information Processing Systems, vol. 33, pp. 5296–5307, 2020

2020
[168]

Diccr: Double-gated intervention and confounder causal reasoning for vision-language navigation,

D. Zhou, J. Deng,et al., “Diccr: Double-gated intervention and confounder causal reasoning for vision-language navigation,”Neural Networks, vol. 184, p. 107078, 2025

2025
[169]

monovln: Bridging the observation gap between monocular and panoramic vision and language navigation,

R. Lu, Y . Zhou,et al., “monovln: Bridging the observation gap between monocular and panoramic vision and language navigation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 9477–9486

2025
[170]

Nerf: Representing scenes as neural radiance fields for view synthesis,

B. Mildenhall, P. P. Srinivasan,et al., “Nerf: Representing scenes as neural radiance fields for view synthesis,” inProceedings of the European Conference on Computer Vision (ECCV), 2020

2020
[171]

3d gaussian splatting for real-time radiance field rendering,

B. Kerbl, G. Kopanas,et al., “3d gaussian splatting for real-time radiance field rendering,”ACM Transactions on Graphics, vol. 42, no. 4, 2023

2023
[172]

Vision-language navigation policy learning and adaptation,

X. Wang, Q. Huang,et al., “Vision-language navigation policy learning and adaptation,”IEEE transactions on pattern analysis and machine intelligence, 2020

2020
[173]

Self-supervised 3-d semantic representation learning for vision-and-language navigation,

S. Tan, K. Sima,et al., “Self-supervised 3-d semantic representation learning for vision-and-language navigation,”IEEE Transactions on Neural Networks and Learning Systems, pp. 1–14, 2024

2024
[174]

Hop: History-and-order aware pre-training for vision-and-language navigation,

Y . Qiao, Y . Qi,et al., “Hop: History-and-order aware pre-training for vision-and-language navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 15 418–15 427

2022
[175]

Hop+: History-enhanced and order-aware pre- training for vision-and-language navigation,

Y . Qiao, Y . Qi,et al., “Hop+: History-enhanced and order-aware pre- training for vision-and-language navigation,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023

2023
[176]

From history to goal: Enhanced vision- and-language navigation with historical traceability,

X. Zhu, M. Wang,et al., “From history to goal: Enhanced vision- and-language navigation with historical traceability,” in2025 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2025, pp. 1–6

2025
[177]

Mg-vln: Benchmarking multi-goal and long- horizon vision-language navigation with language enhanced memory map,

J. Zhang and K. Ma, “Mg-vln: Benchmarking multi-goal and long- horizon vision-language navigation with language enhanced memory map,” in2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2024, pp. 7750–7757

2024
[178]

Think hierarchically, act dynamically: Hierarchical multi-modal fusion and reasoning for vision-and-language navigation,

J. Yue, Y . Zhang,et al., “Think hierarchically, act dynamically: Hierarchical multi-modal fusion and reasoning for vision-and-language navigation,”arXiv preprint arXiv:2504.16516, 2025

2025 arXiv
[179]

Vln-khvr: Knowledge-and-history aware visual representation for continuous vision-and-language navigation,

P. Kong, R. Liu,et al., “Vln-khvr: Knowledge-and-history aware visual representation for continuous vision-and-language navigation,” in2025 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2025, pp. 5236–5243

2025
[180]

Vision-and-language navigation based on history-aware cross-modal feature fusion in indoor environment,

S. Wen, S. Gong,et al., “Vision-and-language navigation based on history-aware cross-modal feature fusion in indoor environment,” Knowledge-Based Systems, vol. 305, p. 112610, 2024

2024
[181]

Towards coarse-grained visual language navigation task planning enhanced by event knowledge graph,

K. Zhao, Y . Song,et al., “Towards coarse-grained visual language navigation task planning enhanced by event knowledge graph,” in Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 2024, pp. 3320–3330

2024
[182]

Weakly-supervised multi-granularity map learning for vision-and-language navigation,

P. Chen, D. Ji,et al., “Weakly-supervised multi-granularity map learning for vision-and-language navigation,”Advances in Neural In- formation Processing Systems, vol. 35, pp. 38 149–38 161, 2022

2022
[183]

V olumetric environment representation for vision-language navigation,

R. Liu, W. Wang, and Y . Yang, “V olumetric environment representation for vision-language navigation,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024, pp. 16 317–16 328

2024
[184]

Ovl-map: An online visual language map approach for vision-and-language navigation in continuous environ- ments,

S. Wen, Z. Zhang,et al., “Ovl-map: An online visual language map approach for vision-and-language navigation in continuous environ- ments,”IEEE Robotics and Automation Letters, 2025

2025
[185]

Agent modeling as auxiliary task for deep reinforcement learning,

P. Hernandez-Leal, B. Kartal, and M. E. Taylor, “Agent modeling as auxiliary task for deep reinforcement learning,” inProceedings of the AAAI conference on artificial intelligence and interactive digital entertainment, vol. 15, no. 1, 2019, pp. 31–37

2019
[186]

Adaptive auxiliary task weighting for reinforcement learning,

X. Lin, H. Baweja,et al., “Adaptive auxiliary task weighting for reinforcement learning,”Advances in neural information processing systems, vol. 32, 2019

2019
[187]

Self-monitoring navigation agent via auxiliary progress estimation,

C.-Y . Ma, J. Lu,et al., “Self-monitoring navigation agent via auxiliary progress estimation,” inProceedings of the International Conference on Learning Representations (ICLR), 2019

2019
[188]

The regretful agent: Heuristic-aided navi- gation through progress estimation,

C.-Y . Ma, Z. Wu,et al., “The regretful agent: Heuristic-aided navi- gation through progress estimation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 6732–6740

2019
[189]

Vision-language navigation with self-supervised auxiliary reasoning tasks,

F. Zhu, Y . Zhu,et al., “Vision-language navigation with self-supervised auxiliary reasoning tasks,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 10 012–10 022

2020
[190]

Active visual information gathering for vision-language navigation,

H. Wang, W. Wang,et al., “Active visual information gathering for vision-language navigation,” inEuropean conference on computer vision. Springer, 2020, pp. 307–322. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 29

2020
[191]

Rethinking the spatial route prior in vision-and-language navigation,

X. Zhou, W. Liu, and Y . Mu, “Rethinking the spatial route prior in vision-and-language navigation,”arXiv preprint arXiv:2110.05728, 2021

2021 arXiv
[192]

Structure-encoding auxiliary tasks for improved visual representation in vision-and-language navigation,

C.-W. Kuo, C.-Y . Ma,et al., “Structure-encoding auxiliary tasks for improved visual representation in vision-and-language navigation,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023, pp. 1104–1113

2023
[193]

Target-driven structured transformer planner for vision-language navigation,

Y . Zhao, J. Chen,et al., “Target-driven structured transformer planner for vision-language navigation,” inProceedings of the 30th ACM International Conference on Multimedia, 2022, pp. 4194–4203

2022
[194]

Hierarchical spatial proximity reasoning for vision- and-language navigation,

M. Xu and Z. Xie, “Hierarchical spatial proximity reasoning for vision- and-language navigation,”IEEE Robotics and Automation Letters, vol. 9, no. 12, pp. 10 756–10 763, 2024

2024
[195]

Magic: Meta-ability guided interactive chain- of-distillation for effective-and-efficient vision-and-language naviga- tion,

L. Wang, Z. He,et al., “Magic: Meta-ability guided interactive chain- of-distillation for effective-and-efficient vision-and-language naviga- tion,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026

2026
[196]

Openfly: A versatile toolchain and large-scale benchmark for aerial vision-language navigation,

Y . Gao, C. Li,et al., “Openfly: A versatile toolchain and large-scale benchmark for aerial vision-language navigation,” inProceedings of the International Conference on Learning Representations (ICLR), 2026

2026
[197]

Environment-agnostic multitask learning for natural language grounded navigation,

X. E. Wang, V . Jain,et al., “Environment-agnostic multitask learning for natural language grounded navigation,” inEuropean conference on computer vision. Springer, 2020, pp. 413–430

2020
[198]

Same: Learning generic language-guided visual navigation with state-adaptive mixture of experts,

G. Zhou, Y . Hong,et al., “Same: Learning generic language-guided visual navigation with state-adaptive mixture of experts,” inProceed- ings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 7794–7807

2025
[199]

Foam: A follower-aware speaker model for vision-and-language navigation,

Z.-Y . Dou and N. Peng, “Foam: A follower-aware speaker model for vision-and-language navigation,” inProceedings of the 2022 Confer- ence of the North American Chapter of the Association for Compu- tational Linguistics: Human Language Technologies, 2022, pp. 4332– 4340

2022
[200]

Pasts: Progress-aware spatio-temporal trans- former speaker for vision-and-language navigation,

L. Wang, C. Liu,et al., “Pasts: Progress-aware spatio-temporal trans- former speaker for vision-and-language navigation,”Engineering Ap- plications of Artificial Intelligence, vol. 128, p. 107487, 2024

2024
[201]

Res-sts: Referring expression speaker via self-training with scorer for goal-oriented vision-language navigation,

L. Wang, Z. He,et al., “Res-sts: Referring expression speaker via self-training with scorer for goal-oriented vision-language navigation,” IEEE Transactions on Circuits and Systems for Video Technology, 2023

2023
[202]

Lana: A language-capable navigator for instruction following and generation,

X. Wang, W. Wang,et al., “Lana: A language-capable navigator for instruction following and generation,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 19 048–19 058

2023
[203]

Spatially-aware speaker for vision- and-language navigation instruction generation,

M. Gopinathan, M. Masek,et al., “Spatially-aware speaker for vision- and-language navigation instruction generation,” inProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024, pp. 13 601–13 614

2024
[204]

Less is more: Generating grounded navigation instructions from landmarks,

S. Wang, C. Montgomery,et al., “Less is more: Generating grounded navigation instructions from landmarks,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 15 428–15 438

2022
[205]

A new path: Scaling vision-and- language navigation with synthetic instructions and imitation learning,

A. Kamath, P. Anderson,et al., “A new path: Scaling vision-and- language navigation with synthetic instructions and imitation learning,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 10 813–10 823

2023
[206]

Matterport3D: Learning from RGB-D data in indoor environments,

A. Chang, A. Dai,et al., “Matterport3D: Learning from RGB-D data in indoor environments,”International Conference on 3D Vision (3DV), 2017

2017
[207]

Generating vision-language navigation instruc- tions incorporated fine-grained alignment annotations,

Y . Cui, L. Xie,et al., “Generating vision-language navigation instruc- tions incorporated fine-grained alignment annotations,”Information Fusion, p. 104107, 2025

2025
[208]

Habitat-matterport 3d dataset (hm3d): 1000 large-scale 3d environments for embodied ai,

S. K. Ramakrishnan, A. Gokaslan,et al., “Habitat-matterport 3d dataset (hm3d): 1000 large-scale 3d environments for embodied ai,” inProceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, vol. 1. Curran, 2021

2021
[209]

Gibson env: Real-world perception for embodied agents,

F. Xia, A. R. Zamir,et al., “Gibson env: Real-world perception for embodied agents,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 9068–9079

2018
[210]

Mantis: Interleaved multi-image instruction tuning,

D. Jiang, X. He,et al., “Mantis: Interleaved multi-image instruction tuning,”Transactions on Machine Learning Research, 2024

2024
[211]

Navigation world models,

A. Bar, G. Zhou,et al., “Navigation world models,” inProceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 15 791–15 801

2025
[212]

Navmorph: A self-evolving world model for vision-and-language navigation in continuous environments,

X. Yao, J. Gao, and C. Xu, “Navmorph: A self-evolving world model for vision-and-language navigation in continuous environments,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025

2025
[213]

Pathdreamer: A world model for indoor navigation,

J. Y . Koh, H. Lee,et al., “Pathdreamer: A world model for indoor navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 14 738–14 748

2021
[214]

Dreamwalker: Mental planning for con- tinuous vision-language navigation,

H. Wang, W. Liang,et al., “Dreamwalker: Mental planning for con- tinuous vision-language navigation,” inProceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 10 873–10 883

2023
[215]

Vision language navigation with knowledge- driven environmental dreamer,

F. Zhu, V . C. Lee,et al., “Vision language navigation with knowledge- driven environmental dreamer,” inInternational Joint Conference on Artificial Intelligence 2023. Association for the Advancement of Artificial Intelligence (AAAI), 2023, pp. 1840–1848

2023
[216]

Panogen: Text-conditioned panoramic envi- ronment generation for vision-and-language navigation,

J. Li and M. Bansal, “Panogen: Text-conditioned panoramic envi- ronment generation for vision-and-language navigation,”Advances in neural information processing systems, vol. 36, pp. 21 878–21 894, 2023

2023
[217]

Why only text: empowering vision-and- language navigation with multi-modal prompts,

H. Hong, S. Wang,et al., “Why only text: empowering vision-and- language navigation with multi-modal prompts,” inProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024, pp. 839–847

2024
[218]

Improving vision-and-language navigation with image-text pairs from the web,

A. Majumdar, A. Shrivastava,et al., “Improving vision-and-language navigation with image-text pairs from the web,” inEuropean Confer- ence on Computer Vision. Springer, 2020, pp. 259–274

2020
[219]

Learning from unlabeled 3d environments for vision-and-language navigation,

S. Chen, P.-L. Guhur,et al., “Learning from unlabeled 3d environments for vision-and-language navigation,” inEuropean Conference on Com- puter Vision. Springer, 2022, pp. 638–655

2022
[220]

Scaling up visual and vision-language represen- tation learning with noisy text supervision,

C. Jia, Y . Yang,et al., “Scaling up visual and vision-language represen- tation learning with noisy text supervision,” inInternational conference on machine learning. PMLR, 2021, pp. 4904–4916

2021
[221]

Bert: Pre-training of deep bidirectional transformers for language understanding,

J. Devlin, M.-W. Chang,et al., “Bert: Pre-training of deep bidirectional transformers for language understanding,” inProceedings of NAACL- HLT, 2019

2019
[222]

Training language models to follow instructions with human feedback,

L. Ouyang, J. Wu,et al., “Training language models to follow instructions with human feedback,”Advances in Neural Information Processing Systems, 2022

2022
[223]

Llm-grounder: Open-vocabulary 3d visual grounding with large language model as an agent,

J. Yang, X. Chen,et al., “Llm-grounder: Open-vocabulary 3d visual grounding with large language model as an agent,” in2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024, pp. 7694–7701

2024
[224]

Language to map: Topolog- ical map generation from natural language path instructions,

H. Deguchi, K. Shibata, and S. Taguchi, “Language to map: Topolog- ical map generation from natural language path instructions,” in2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024, pp. 9556–9562

2024
[225]

Vision-and-language navigation with ana- logical textual descriptions in LLMs,

Y . Zhang, T. Ma,et al., “Vision-and-language navigation with ana- logical textual descriptions in LLMs,” inProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, C. Christodoulopoulos, T. Chakraborty,et al., Eds. Suzhou, China: Association for...

2025
[226]

Over-nav: Elevating iterative vision-and- language navigation with open-vocabulary detection and structured rep- resentation,

G. Zhao, G. Li,et al., “Over-nav: Elevating iterative vision-and- language navigation with open-vocabulary detection and structured rep- resentation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 16 296–16 306

2024
[227]

Open-nav: Exploring zero-shot vision-and- language navigation in continuous environment with open-source llms,

Y . Qiao, W. Lyu,et al., “Open-nav: Exploring zero-shot vision-and- language navigation in continuous environment with open-source llms,” in2025 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2025, pp. 6710–6717

2025
[228]

Smartway: Enhanced waypoint prediction and backtracking for zero-shot vision-and-language navigation,

X. Shi, Z. Li,et al., “Smartway: Enhanced waypoint prediction and backtracking for zero-shot vision-and-language navigation,”CoRR, 2025

2025
[229]

Citynavagent: Aerial vision-and-language navigation with hierarchical semantic planning and global memory,

W. Zhang, C. Gao,et al., “Citynavagent: Aerial vision-and-language navigation with hierarchical semantic planning and global memory,” inProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL), 2025

2025
[230]

Constraint-aware zero-shot vision-language navigation in continuous environments,

K. Chen, D. An,et al., “Constraint-aware zero-shot vision-language navigation in continuous environments,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025

2025
[231]

Sfco-nav: Efficient zero-shot visual language navigation via collaboration of slow llm and fast attributed graph alignment,

C. Xiong, L. Wei,et al., “Sfco-nav: Efficient zero-shot visual language navigation via collaboration of slow llm and fast attributed graph alignment,”arXiv preprint arXiv:2603.01477, 2026

2026
[232]

Navhint: Vision and language navigation agent with a hint generator

Y . Zhang, Q. Guo, and P. Kordjamshidi, “Navhint: Vision and language navigation agent with a hint generator.” Association for Computational Linguistics, 2024

2024
[233]

Navgpt-2: Unleashing navigational reasoning capability for large vision-language models,

G. Zhou, Y . Hong,et al., “Navgpt-2: Unleashing navigational reasoning capability for large vision-language models,” inEuropean Conference on Computer Vision. Springer, 2024, pp. 260–278

2024
[234]

Flame: Learning to navigate with multimodal llm in urban environments,

Y . Xu, Y . Pan,et al., “Flame: Learning to navigate with multimodal llm in urban environments,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 9, 2025, pp. 9005–9013. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 30

2025
[235]

Towards learning a generalist model for embodied navigation,

D. Zheng, S. Huang,et al., “Towards learning a generalist model for embodied navigation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 13 624–13 634

2024
[236]

Na vid-4d: Unleashing spatial intelligence in egocentric rgb-d videos for vision-and-language navigation,

H. Liu, W. Wan,et al., “Na vid-4d: Unleashing spatial intelligence in egocentric rgb-d videos for vision-and-language navigation,” in2025 IEEE International Conference on Robotics and Automation (ICRA), 2025, pp. 10 607–10 615

2025
[237]

VISITRON: Visual semantics-aligned interactively trained object-navigator,

A. Shrivastava, K. Gopalakrishnan,et al., “VISITRON: Visual semantics-aligned interactively trained object-navigator,” inFindings of the Association for Computational Linguistics: ACL 2022, S. Muresan, P. Nakov, and A. Villavicencio, Eds. Dublin, Ireland: Association for Compu...

2022
[238]

Can pretrained vision-language embed- dings alone guide robot navigation?

N. Subedi, A. Haroon,et al., “Can pretrained vision-language embed- dings alone guide robot navigation?”arXiv preprint arXiv:2506.14507, 2025

2025 arXiv
[239]

Learning phrase representations using RNN encoder–decoder for statistical machine translation,

K. Cho, B. van Merri ¨enboer,et al., “Learning phrase representations using RNN encoder–decoder for statistical machine translation,” in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014, pp. 1724–1734

2014
[240]

Dagger diffusion navigation: Dagger boosted diffusion policy for vision-language navigation,

H. Shi, X. Deng,et al., “Dagger diffusion navigation: Dagger boosted diffusion policy for vision-language navigation,”arXiv preprint arXiv:2508.09444, 2025

2025 arXiv
[241]

A reduction of imitation learning and structured prediction to no-regret online learning,

S. Ross, G. J. Gordon, and J. A. Bagnell, “A reduction of imitation learning and structured prediction to no-regret online learning,” inPro- ceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS), 2011, pp. 627–635

2011
[242]

Cvln-think: Causal inference with counterfactual style adaptation for continuous vision-and-language navigation,

R. Liu, S. Wu,et al., “Cvln-think: Causal inference with counterfactual style adaptation for continuous vision-and-language navigation,” in 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2025, pp. 15 299–15 305

2025
[243]

ArraMon: A joint navigation-assembly instruction interpretation task in dynamic environments,

H. Kim, A. Zala,et al., “ArraMon: A joint navigation-assembly instruction interpretation task in dynamic environments,” inFindings of the Association for Computational Linguistics: EMNLP 2020, T. Cohn, Y . He, and Y . Liu, Eds. Online: Association for Computational Linguistics...

2020
[244]

Multimodal text style transfer for outdoor vision-and-language navigation,

W. Zhu, X. Wang,et al., “Multimodal text style transfer for outdoor vision-and-language navigation,” inProceedings of the 16th Confer- ence of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021, pp. 1207–1221

2021
[245]

Analyzing generalization of vision and language navigation to unseen outdoor areas,

R. Schumann and S. Riezler, “Analyzing generalization of vision and language navigation to unseen outdoor areas,” inProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), S. Muresan, P. Nakov, and A. Villavicencio, Eds....

2022
[246]

Loc4plan: Locating before planning for outdoor vision and language navigation,

H. Tian, J. Meng,et al., “Loc4plan: Locating before planning for outdoor vision and language navigation,” inProceedings of the 32nd ACM International Conference on Multimedia, ser. MM ’24. New York, NY , USA: Association for Computing Machinery, 2024, p. 4073–4081

2024
[247]

Citynav: A large-scale dataset for real- world aerial navigation,

J. Lee, T. Miyanishi,et al., “Citynav: A large-scale dataset for real- world aerial navigation,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2025, pp. 5912–5922

2025
[248]

Asma: An a daptive s afety m argin a lgorithm for vision-language drone navigation via scene-aware control barrier functions,

S. Sanyal and K. Roy, “Asma: An a daptive s afety m argin a lgorithm for vision-language drone navigation via scene-aware control barrier functions,”IEEE Robotics and Automation Letters, vol. 10, no. 9, pp. 9232–9239, 2025

2025
[249]

Grad-nav++: Vision-language model enabled visual drone navigation with gaussian radiance fields and differentiable dynamics,

Q. Chen, N. Gao,et al., “Grad-nav++: Vision-language model enabled visual drone navigation with gaussian radiance fields and differentiable dynamics,”IEEE Robotics and Automation Letters, vol. 11, no. 2, pp. 1418–1425, 2025

2025
[250]

Activevln: Towards active exploration via multi-turn rl in vision-and-language navigation,

Z. Zhang, W. Zhu,et al., “Activevln: Towards active exploration via multi-turn rl in vision-and-language navigation,”arXiv preprint arXiv:2509.12618, 2025

2025
[251]

Cast: Counterfactual labels improve instruction following in vision-language-action models,

C. Glossop, W. Chen,et al., “Cast: Counterfactual labels improve instruction following in vision-language-action models,”arXiv preprint arXiv:2508.13446, 2025

2025 arXiv
[252]

Adanav: Adaptive reasoning with uncertainty for vision-language navigation,

X. Ding, J. Wei,et al., “Adanav: Adaptive reasoning with uncertainty for vision-language navigation,”arXiv preprint arXiv:2509.24387, 2025

2025
[253]

Aux-think: Exploring reasoning strategies for data-efficient vision-language navigation,

S. Wang, Y . Wang,et al., “Aux-think: Exploring reasoning strategies for data-efficient vision-language navigation,” inAdvances in Neural Information Processing Systems, 2025

2025
[254]

MapNav: A novel memory representation via annotated semantic maps for VLM-based vision-and-language navigation,

L. Zhang, X. Hao,et al., “MapNav: A novel memory representation via annotated semantic maps for VLM-based vision-and-language navigation,” inProceedings of the 63rd Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), W. Che, J. Nabende,et...

2025
[255]

Gc-vln: Instruction as graph constraints for training-free vision-and-language navigation,

H. Yin, H. Wei,et al., “Gc-vln: Instruction as graph constraints for training-free vision-and-language navigation,” inConference on Robot Learning. PMLR, 2025, pp. 1809–1824

2025
[256]

Vln-zero: Rapid exploration and cache- enabled neurosymbolic vision-language planning for zero-shot transfer in robot navigation,

N. P. Bhatt, Y . Yang,et al., “Vln-zero: Rapid exploration and cache- enabled neurosymbolic vision-language planning for zero-shot transfer in robot navigation,”arXiv preprint arXiv:2509.18592, 2025

2025
[257]

Following route instructions using large vision-language models: A comparison between low-level and panoramic action spaces,

V . K ˚asene and P. Lison, “Following route instructions using large vision-language models: A comparison between low-level and panoramic action spaces,” inProceedings of the 8th International Conference on Natural Language and Speech Processing (ICNLSP- 2025), 2025, pp. 449–463

2025
[258]

Navitrace: Evaluating embodied nav- igation of vision-language models,

T. Windecker, M. Patel,et al., “Navitrace: Evaluating embodied nav- igation of vision-language models,”arXiv preprint arXiv:2510.26909, 2025

2025
[259]

Fast-smartway: Panoramic-free end- to-end zero-shot vision-and-language navigation,

X. Shi, Z. Li,et al., “Fast-smartway: Panoramic-free end- to-end zero-shot vision-and-language navigation,”arXiv preprint arXiv:2511.00933, 2025

2025
[260]

Cl-cotnav: Closed-loop hierarchical chain- of-thought for zero-shot object-goal navigation with vision-language models,

Y . Cai, X. He,et al., “Cl-cotnav: Closed-loop hierarchical chain- of-thought for zero-shot object-goal navigation with vision-language models,”arXiv preprint arXiv:2504.09000, 2025

2025 arXiv
[261]

Omnivla: An omni-modal vision- language-action model for robot navigation,

N. Hirose, C. Glossop,et al., “Omnivla: An omni-modal vision- language-action model for robot navigation,”arXiv preprint arXiv:2509.19480, 2025

2025
[262]

Vln-video: Utilizing driving videos for outdoor vision-and-language navigation,

J. Li, A. Padmakumar,et al., “Vln-video: Utilizing driving videos for outdoor vision-and-language navigation,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 17, 2024, pp. 18 517– 18 526

2024
[263]

Navagent: Multi-scale urban street view fusion for uav embodied vision-and-language navigation,

Y . Liu, F. Yao,et al., “Navagent: Multi-scale urban street view fusion for uav embodied vision-and-language navigation,”arXiv preprint arXiv:2411.08579, 2024

2024 arXiv
[264]

Robot navigation using physically grounded vision-language models in outdoor environments,

M. Elnoor, K. Weerakoon,et al., “Robot navigation using physically grounded vision-language models in outdoor environments,”arXiv preprint arXiv:2409.20445, 2024

2024 arXiv
[265]

Towards physically executable 3d gaussian for embodied navigation,

B. Miao, R. Wei,et al., “Towards physically executable 3d gaussian for embodied navigation,” inProceedings of the International Conference on Learning Representations (ICLR), 2026

2026
[266]

Navcomposer: Composing language in- structions for navigation trajectories through action-scene-object mod- ularization,

Z. He, L. Wang,et al., “Navcomposer: Composing language in- structions for navigation trajectories through action-scene-object mod- ularization,”IEEE Transactions on Circuits and Systems for Video Technology, pp. 1–1, 2025

2025
[267]

Follow the beaten path: The role of route patterns on vision-language navigation agents generalization abilities,

K. T. Baghaei, D. Pfoser, and A. Anastasopoulos, “Follow the beaten path: The role of route patterns on vision-language navigation agents generalization abilities,” inProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational...

2025
[268]

Uav-on: A benchmark for open-world object goal navigation with aerial agents,

J. Xiao, Y . Sun,et al., “Uav-on: A benchmark for open-world object goal navigation with aerial agents,” inProceedings of the 33rd ACM International Conference on Multimedia, ser. MM ’25. New York, NY , USA: Association for Computing Machinery, 2025, p. 13023–13029

2025
[269]

Aerial vision-and-language navigation via semantic-topo-metric representation guided llm reasoning,

Y . Gao, Z. Wang,et al., “Aerial vision-and-language navigation via semantic-topo-metric representation guided llm reasoning,”arXiv preprint arXiv:2410.08500, 2024

2024 arXiv
[270]

Aerial vision-language navigation with a unified framework for spatial, temporal and embodied reasoning,

H. Xu, Z. Liu,et al., “Aerial vision-language navigation with a unified framework for spatial, temporal and embodied reasoning,”arXiv preprint arXiv:2512.08639, 2025

2025 arXiv
[271]

Sa-gcs: Semantic-aware gaussian curricu- lum scheduling for uav vision-language navigation,

H. Cai, J. Dong,et al., “Sa-gcs: Semantic-aware gaussian curricu- lum scheduling for uav vision-language navigation,”arXiv preprint arXiv:2508.00390, 2025

2025 arXiv
[272]

Agrivln: Vision-and-language navigation for agricultural robots,

X. Zhao, X. Lyu, and X. Li, “Agrivln: Vision-and-language navigation for agricultural robots,”arXiv preprint arXiv:2508.07406, 2025

2025 arXiv
[273]

T-aravln: Translator for agricultural robotic agents on vision-and-language navigation,

X. Zhao, X. Lyu, and X. Li, “T-aravln: Translator for agricultural robotic agents on vision-and-language navigation,”arXiv preprint arXiv:2509.06644, 2025

2025
[274]

Sum-agrivln: Spatial understanding mem- ory for agricultural vision-and-language navigation,

X. Zhao, X. Lyu, and X. Li, “Sum-agrivln: Spatial understanding mem- ory for agricultural vision-and-language navigation,”arXiv preprint arXiv:2510.14357, 2025

2025
[275]

Mde-agrivln: Agricultural vision-and- language navigation with monocular depth estimation,

X. Zhao, X. Lyu,et al., “Mde-agrivln: Agricultural vision-and- language navigation with monocular depth estimation,”arXiv preprint arXiv:2512.03958, 2025. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 31

2025
[276]

Underwatervla: Dual-brain vision-language- action architecture for autonomous underwater navigation,

Z. Wang, Y . Zhu,et al., “Underwatervla: Dual-brain vision-language- action architecture for autonomous underwater navigation,”arXiv preprint arXiv:2509.22441, 2025

2025
[277]

Saycan: Grounding language in affordances for collaborative task planning,

W. Ahn, A. Sax,et al., “Saycan: Grounding language in affordances for collaborative task planning,” inRobotics: Science and Systems (RSS), 2022. [Online]. Available: https://arxiv.org/abs/2204.01691

2022 arXiv
[278]

Rt-2: Vision-language-action models transfer web knowledge to robotic control,

B. Zitkovich, T. Yu,et al., “Rt-2: Vision-language-action models transfer web knowledge to robotic control,” inConference on Robot Learning. PMLR, 2023, pp. 2165–2183

2023
[279]

Continual vision-and-language navigation,

S. Jeong, G.-C. Kang,et al., “Continual vision-and-language navigation,” in36th British Machine Vision Conference 2025, BMVC 2025, Sheffield, UK, November 24-27, 2025. BMV A, 2025. [Online]. Available: https://bmva-archive.org.uk/bmvc/2025/assets/papers/Paper 84/paper.pdf

2025
[280]

All-day multi-scenes lifelong vision-and- language navigation with tucker adaptation,

X. Wang, G. Li,et al., “All-day multi-scenes lifelong vision-and- language navigation with tucker adaptation,” inInternational Confer- ence on Learning Representations, 2026

2026
[281]

Vision-language navigation with continual learn- ing,

Z. Li, Y . Lv,et al., “Vision-language navigation with continual learn- ing,”arXiv preprint arXiv:2409.02561, 2024

2024 arXiv
[282]

M 3e: Continual vision-and-language navigation via mixture of macro and micro experts,

Y . Jiang, H. Zhang,et al., “M 3e: Continual vision-and-language navigation via mixture of macro and micro experts,” inInternational Conference on Learning Representations, 2026

2026

Pith tools

Reviewed July 14, 2026 · model on record in the stance chip above.

[1] [1]

On the representation and estimation of spatial uncertainty,

R. C. Smith and P. Cheeseman, “On the representation and estimation of spatial uncertainty,”The International Journal of Robotics Research, vol. 5, no. 4, pp. 56–68, 1986. [Online]. Available: https://doi.org/10.1177/027836498600500404

doi:10.1177/027836498600500404 1986

[2] [2]

Smith, M

R. Smith, M. Self, and P. Cheeseman,Estimating Uncertain Spatial Relationships in Robotics. New York, NY: Springer New York, 1990, pp. 167–193. [Online]. Available: https://doi.org/10.1007/ 978-1-4613-8997-2 14

1990

[3] [3]

Visual odometry,

D. Nister, O. Naroditsky, and J. Bergen, “Visual odometry,” inPro- ceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., vol. 1, 2004, pp. I–I

2004

[4] [4]

Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,

R. Mur-Artal and J. D. Tard ´os, “Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras,”IEEE Transactions on Robotics, vol. 33, no. 5, pp. 1255–1262, 2017

2017

[5] [5]

Vision-and-language navigation: Interpret- ing visually-grounded navigation instructions in real environments,

P. Anderson, Q. Wu,et al., “Vision-and-language navigation: Interpret- ing visually-grounded navigation instructions in real environments,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 3674–3683

2018

[6] [6]

Stay on the path: Instruction fidelity in vision-and-language navigation,

V . Jain, G. Magalhaes,et al., “Stay on the path: Instruction fidelity in vision-and-language navigation,” inProceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, pp. 1862–1872

2019

[7] [7]

Room-across-room: Multilingual vision- and-language navigation with dense spatiotemporal grounding,

A. Ku, P. Anderson,et al., “Room-across-room: Multilingual vision- and-language navigation with dense spatiotemporal grounding,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 4392–4412

2020

[8] [8]

Beyond the nav-graph: Vision-and- language navigation in continuous environments,

J. Krantz, E. Wijmans,et al., “Beyond the nav-graph: Vision-and- language navigation in continuous environments,” inComputer Vision – ECCV 2020, A. Vedaldi, H. Bischof,et al., Eds. Springer International Publishing, pp. 104–120. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 25

2020