REVIEW 18 cited by
InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Enabling robots to navigate following diverse language instructions in unexplored environments is an attractive goal for human-robot interaction. However, this goal is challenging because different navigation tasks require different strategies. The scarcity of instruction navigation data hinders training an instruction navigation model with varied strategies. Therefore, previous methods are all constrained to one specific type of navigation instruction. In this work, we propose InstructNav, a generic instruction navigation system. InstructNav makes the first endeavor to handle various instruction navigation tasks without any navigation training or pre-built maps. To reach this goal, we introduce Dynamic Chain-of-Navigation (DCoN) to unify the planning process for different types of navigation instructions. Furthermore, we propose Multi-sourced Value Maps to model key elements in instruction navigation so that linguistic DCoN planning can be converted into robot actionable trajectories. With InstructNav, we complete the R2R-CE task in a zero-shot way for the first time and outperform many task-training methods. Besides, InstructNav also surpasses the previous SOTA method by 10.48% on the zero-shot Habitat ObjNav and by 86.34% on demand-driven navigation DDN. Real robot experiments on diverse indoor scenes further demonstrate our method's robustness in coping with the environment and instruction variations.
Forward citations
Cited by 18 Pith papers
-
BioVLN: A Simulation Platform for Visual Language Navigation in Biomedical Laboratories
BioVLN introduces a three-zone operational envelope for biomedical lab navigation, with 47 scenes and benchmarks showing multi-point operation-area goals raise success to 83–92% while cutting unsafe proximity.
-
Joint On-and-Off Policy Learning for Vision-and-Language Navigation
JOP-VLN combines DAgger imitation learning with GRPO reinforcement learning, using high-entropy trajectory filtering and error-correction prioritization, achieving 69.9% SR on R2R Val-Unseen.
-
ABot-N1: Toward a General Visual Language Navigation Foundation Model
A slow–fast VLN model that routes five navigation tasks through CoT plus image-space pixel goals reaches SOTA on established and new urban benchmarks, including 77.3% POI arrival.
-
DRIVE-Nav: Directional Reasoning, Inspection, and Verification for Efficient Open-Vocabulary Navigation
Organizing zero-shot object navigation around tracked directional exits with 240° inspection and VLM verification yields 50.2% SR / 32.6% SPL on HM3D-OVON and best SPL on HM3Dv2 and MP3D.
-
Structured Observation Language for Efficient and Generalizable Vision-Language Navigation
SOL-Nav encodes RGB-D observations as grid-organized text and uses a 0.6B text-embedding model with four classification heads to predict navigation action blocks, reporting SOTA/comparable R2R-CE/RxR-CE results with 1...
-
HiMemVLN: Enhancing Reliability of Open-Source Zero-Shot Vision-and-Language Navigation with Hierarchical Memory System
A hierarchical memory system—visual graph memory for re-visit detection plus a global instruction tracker—raises open-source zero-shot VLN success rate to 30% from 14% on R2R-CE.
-
Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigation
The submitted abstract, the paper body, and the conclusion report incompatible headline results (73.2/75.6, 64.2/67.0, and 62.3/64.5 SR on R2R-CE/RxR-CE), so the claimed state of the art is not internally consistent.
-
PIGEON: VLM-Driven Object Navigation via Points of Interest Selection
PIGEON selects sparse Points of Interest for VLM-driven object navigation, achieving state-of-the-art zero-shot ObjectNav results in Habitat and improving a local 7B VLM via distance-based RLVR.
-
MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning
A four-camera VLA navigation model trained by distilling multiple RL experts achieves strong simulation performance and qualitative real-world transfer.
-
DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigation
DreamNav achieves new zero-shot SOTA on VLN-CE with an egocentric-only pipeline that generates candidate trajectories, imagines their futures, and selects the best by language alignment.
-
CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Model
By iteratively retraining on automatically generated corrective examples derived from its own wrong paths, CorrectNav reports new state-of-the-art success rates of 65.1% (R2R-CE) and 69.3% (RxR-CE).
-
Imaginative World Modeling with Scene Graphs for Embodied Agent Navigation
SGImagineNav uses an imagined hierarchical scene graph, filled in by an LLM, that guides a robot to unseen objects and achieves 65.4% and 66.8% success on HM3D and HSSD.
-
StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modeling
A streaming navigation framework combining a sliding-window KV cache with depth-based token pruning achieves state-of-the-art results on VLN-CE benchmarks with bounded context and low latency.
-
CheckManual: A New Challenge and Benchmark for Manual-based Appliance Manipulation
A first benchmark that tests whether robots can read multi-page appliance manuals and then plan and execute manipulation tasks on appliances in simulation.
-
MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation
Pyramidal multi-resolution visual memory plus single-token mid-level actions let a 4B–8B VLM navigate continuous indoor environments at 14 FPS with SOTA R2R/RxR success rates.
-
HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models
Hierarchical LLM room-type inference plus object-room affinity scoring yields 84.0% Gibson and 53.0% HM3D success for zero-shot object-goal navigation.
-
CogDDN: A Cognitive Demand-Driven Navigation with Decision Optimization and Dual-Process Thinking
CogDDN uses a fast heuristic VLM paired with a slow analytic reflection process and a growing knowledge base to navigate to objects that implicitly satisfy a user's demand, with large reported gains on AI2Thor DDN benchmarks.
-
Nav-R1: Reasoning and Navigation in Embodied Scenes
Nav-R1 uses a 110K synthetic CoT dataset, GRPO with three rewards, and a fast-in-slow system to set new SOTA on R2R-CE, RxR-CE, and HM3D-OVON.
Discussion (0). Sign in to comment.