task · first seen 4 Oct 2026
vision-language navigation
Also: VLN, VLM navigation, VLM-based navigation, language-guided navigation, vision-and-language navigation, language-conditioned navigation, vision-language model navigation
Embodied agents follow natural language instructions to navigate through visual environments.
Vision-and-language navigation is the embodied AI task in which an agent follows natural-language instructions through visual environments, typically benchmarked on Room-to-Room and its continuous-environment variants since 2018. The sources show ordinary steady output rather than a new idea. Recent papers cover aerial and UAV navigation with compact memory, parallel action decoding, episodic-memory replay for online adaptation, progress verification for long-horizon tasks, sim-to-real transfer on an Ackermann-steered robot, and an accessibility benchmark. Repositories from OpenGVLab, OpenDriveLab and others build VLN agents on native multimodal LLMs or on internet-video pretraining. The common thread is replacing purpose-built VLN models with large vision-language model backbones.
The task is a long-standing benchmark area, and the recent work mainly tests whether general multimodal models can be made efficient and reliable enough for onboard robot and drone deployment. Progress there would carry over to practical instruction-following robots.
Analyst note (established), 18 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 71 on 15 Nov 2026 · 22 mentions in 28 days · 22 independent groups · papers → code · first seen 6 weeks ago · acceleration +0.24
Earliest sources
- LightVLN: Efficient Aerial Vision-and-Language Navigation with Compact Memory and History-Guided Local AggregationPapers · 4 Oct 2026 · Yiming Zhao, Tianshun Li, Jingle He, Ruonan Chai, Xinhu Zheng
- StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language NavigationPapers · 5 Oct 2026 · Anh Dao, Quan-Dung Pham, Le Danh Vinh, The Anh Nguyen, Nguyen Viet Tri Pham, Yiy…
- MarvisNav: Making Memory Visible on Route Choices for Zero-Shot Object NavigationPapers · 5 Oct 2026 · Jincheng Wang, Chi Pui Chan, Wei Zeng, Shuyang Zhang, Jianhao Jiao, Dimitrios Ka…
- Sim-to-Real Transfer of Vision-Language Navigation in Continuous Environments Using an Ackermann-Steered Mobile RobotPapers · 5 Oct 2026 · Chalindu Abeywansa, Sahan Gunasekara, Devindi De Silva, Seniru Dissanayake, Rang…
- What the Elevation Map Cannot See: Semantic-Aware Locomotion and Execution-Aware Navigation for Humanoid RobotPapers · 5 Oct 2026 · Shunyu Yao, Songyang Liu, Dinghao Chen, Yuanyuan Lei, Shuai Li
- Speaking the Navigator's Language: Trajectory-Grounded Instruction Translation for Frozen Aerial VLN AgentsPapers · 7 Oct 2026 · Xi Chen, Zhe Liu, Xiaogang Xu, Jiafei Xu, Chunyi Zhou, Yuan Su, Rui Zeng, Tianyu…
Latest sources
- Learning and Verifying Progress: Closed-Loop Agentic Planning with Progress-Enhanced Execution for Long-Horizon Vision-Language NavigationPapers · 16 Nov 2026 · Kangjie Zhou, Sukai Wang, Yuhan Xiao, Qinghang Liu, Zhejia Wen, ChunXuan Jiao, W…
- Remember, Replay, Adapt: Learning from Past Experience in Online Vision-and-Language NavigationPapers · 15 Nov 2026 · Chenhao Ding, Jizhou Han, Lixin Xiu, Muyao Wang, Songlin Dong, Hideki Nakayama
- VLN-Flash: Parallel Action Decoding with Adaptive Execution for Vision-and-Language NavigationPapers · 14 Nov 2026 · Ruizhe Xie, Honghua Chen, Binglin Wang, Tong Guo, Xu Tang, Puti Yan, Shaoxiong C…
- VLAN: Vision-Language Accessible NavigationPapers · 13 Nov 2026 · Jie Hu, Yu Zheng, Wenzhi Wu, Weixing Feng, Cunlei Cheng, Jiaming Zhang
- ProtoVis-Nav: Prototypical Visual Imagination for Visual-Spatial Aligned UAV NavigationPapers · 12 Nov 2026 · Guangyuan Sui, Yunzhong Hou, Chi Harold Liu
- OpenDriveLab/CompassCode · 10 Nov 2026 · OpenDriveLab · 43 stars
- MOSU2: Long-range Navigation System with Multi-modal Scene UnderstandingPapers · 8 Nov 2026 · Jing Liang, Zhenyu Hou, Senthurbavan Kirubaharan, Md Safwan Mondal, Ashok Gudiva…
- CPNav: Calibrated Vision-Language Navigation for Object-Goal Search in Unseen EnvironmentsPapers · 7 Nov 2026 · Qizhao Chen, Yuanhong Zeng, Shoh Nishino, Anushri Dixit
- WayTrace: A Map-to-Language-to-Trace Hierarchy for Embodied Urban NavigationPapers · 3 Nov 2026 · Manthan Patel, Jonas Frey, Pascal Roth, Marco Hutter, Cesar Cadena
- Caging Vision-Language Navigation for Legged Robots via Barrier-Certified Safety ArchitecturePapers · 3 Nov 2026 · Abhijeet M. Kulkarni, Saimouli Katragadda, Yuze Du, Zijun Sha, Guoquan Huang
- Ask to Evolve: A Unified Harness for Lifelong Embodied Navigation with Hybrid Action Space and Persistent MemoryPapers · 29 Oct 2026 · Kai Sheng, Liuyi Wang, Jinlong Li, Haojie Dai, Chengju Liu, Qijun Chen
- What Should a Navigator Remember? Spatiotemporal Memory for Zero-Shot Vision-Language NavigationPapers · 28 Oct 2026 · Yuhang Peng, Zhikai Wang, Ziyi Wang, Jiaru Zhong, Xiaoji Zheng, Jingzhi Huang, Y…