analiza aiqbench
CoralPlan represents a significant step in applying vision-language models to autonomous robotics, specifically enabling underwater systems to dynamically select and execute complex inspection trajectories based on task descriptions. By bridging the gap between high-level language commands and low-level motion primitives like orbit or patch surveys, this system demonstrates how multimodal AI can enhance the operational reliability of specialized robotic hardware. The study provides critical empirical data on where current generation models succeed or fail in translating semantic understanding into precise physical actions within constrained environments.
CoralPlan: Observation Skill Selection and Execution for Underwater Robotic Inspection
arXiv:2609.31211v1 Announce Type: new Abstract: Underwater robotic inspection depends on acquiring views that reveal task-relevant structure. For a structurally complex coral colony, recognising the target is only the starting point: the robot must select and execute a viewing motion suited to the inspection task. We present CoralPlan, a vision-language system that selects an observation skill from a current camera image and task text supplied by an episode manifest. A shared motion interface executes orbit, patch, or survey as target-relative trajectories; the remaining plan fields provide operator guidance. Observation completion requires target keeping and primitive-specific coverage, while joint success also requires selection to match the recorded reference. We evaluate this interface in 144 simulated episodes and 36 matched simulation-hardware pairs. In a clear-water pool with external target-reference poses, hardware observation completion reaches 77.8% and joint success reaches 63.9%. The experiments identify both reference-mismatched completions and incomplete observations after a matching skill selection. These results connect observation-skill choice to measurable underwater execution outcomes and identify where task-directed acquisition succeeds or fails.
Abstract:Underwater robotic inspection depends on acquiring views that reveal task-relevant structure. For a structurally complex coral colony, recognising the target is only the starting point: the robot must select and execute a viewing motion suited to the inspection task. We present CoralPlan, a vision-language system that selects an observation skill from a current camera image and task text supplied by an episode manifest. A shared motion interface executes orbit, patch, or survey as target-relative trajectories; the remaining plan fields provide operator guidance. Observation completion requires target keeping and primitive-specific coverage, while joint success also requires selection to match the recorded reference. We evaluate this interface in 144 simulated episodes and 36 matched simulation-hardware pairs. In a clear-water pool with external target-reference poses, hardware observation completion reaches 77.8% and joint success reaches 63.9%. The experiments identify both reference-mismatched completions and incomplete observations after a matching skill selection. These results connect observation-skill choice to measurable underwater execution outcomes and identify where task-directed acquisition succeeds or fails.
Robotics (cs.RO)
arXiv:2609.31211 [cs.RO]
(or arXiv:2609.31211v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2609.31211 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 257 cuvinte
Subiecte conexe

How to Train a Cross-Embodiment Robot Navigation Policy with AI Agents
NVIDIA · 26 aug. 2026
EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
arXiv · 2 sept. 2026

The Machines that Make the Machines
NVIDIA · 7 oct. 2026
LIBERO-Agent: Evaluating General-Purpose Agents for Direct Embodied Manipulation
arXiv · 1 oct. 2026