End-to-End Autonomous Driving

OpenNav: Open-World Navigation with Multimodal Large Language Models

Mingfeng Yuan, Letian Wang, Steven L. Waslander
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025.

​

Given a free-form language instruction and sensor observations, our OpenNav is capable of generating a dense sequence of instruction-following and scene-compliant robot waypoints in a zero-shot manner for open-world navigation, effectively handling open-set objects and open-set instructions without relying on in-context examples or pre-trained skills.