aiqbench analysis
Map2Route introduces a rigorous benchmark for compositional language-grounded route planning, addressing the critical challenge of interpreting complex, nested spatial instructions over semantic maps. The proposed Grounding2Route framework demonstrates significant improvements in handling must-pass regions and soft preferences, though a notable gap to human-level performance remains. This work advances the field by providing standardized metrics to evaluate how effectively AI agents can translate natural language queries into executable navigation plans.
Map2Route: Benchmarking Compositional Language-Grounded Route Planning over Semantic Maps
arXiv:2609.17910v1 Announce Type: new Abstract: We introduce Map2Route, a human-curated benchmark for compositional language-grounded route planning over pre-built semantic maps. Map2Route contains 1,000 episodes across 40 scenes, where instructions use relational, comparative, and nested descriptions to identify route-relevant objects and regions, while specifying ordered must-pass regions, must-avoid requirements, five categories of soft preferences, and spatial and route-stage scopes, which is partially tested by existing works. Alongside Map2Route, we propose Grounding2Route, which combines executable code-as-grounding with verification-guided repair and scope-aware planning.Across seven representative adapted baselines, Grounding2Route substantially outperforms existing methods in all metrics. Despite these gains, a substantial gap to human demonstrations remains, highlighting the difficulty of Map2Route and the considerable headroom for future progress. Additional qualitative results and resources are available on https://anonymous.4open.science/w/Map2Route-F05F/.
Abstract:We introduce Map2Route, a human-curated benchmark for compositional language-grounded route planning over pre-built semantic maps. Map2Route contains 1,000 episodes across 40 scenes, where instructions use relational, comparative, and nested descriptions to identify route-relevant objects and regions, while specifying ordered must-pass regions, must-avoid requirements, five categories of soft preferences, and spatial and route-stage scopes, which is partially tested by existing works. Alongside Map2Route, we propose Grounding2Route, which combines executable code-as-grounding with verification-guided repair and scope-aware this http URL seven representative adapted baselines, Grounding2Route substantially outperforms existing methods in all metrics. Despite these gains, a substantial gap to human demonstrations remains, highlighting the difficulty of Map2Route and the considerable headroom for future progress. Additional qualitative results and resources are available on this https URL.
Robotics (cs.RO)
arXiv:2609.17910 [cs.RO]
(or arXiv:2609.17910v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2609.17910 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 215 words
Related coverage

[AINews] not much happened today
Latent Space · Sep 10, 2026

Academia is for Ambition — Alex Zhang, MIT
Latent Space · Oct 2, 2026

Futures Drop, Yields And Oil Jump Ahead Of Iran UN Address As Trump - Xi Summit Looms
zerohedge.com · Sep 23, 2026

[AINews] not much happened today
Latent Space · Sep 18, 2026