analiza aiqbench
This research addresses a critical bottleneck in Vision-Language-Action (VLA) models by enabling robust robotic manipulation across variable camera configurations without requiring explicit 3D sensing or novel-view rendering. By decoupling scene representation from action learning through wrist-augmented pose sampling, the framework significantly improves deployment flexibility on real-world platforms like RoboTwin and LIBERO. The work represents a meaningful advancement in making foundational VLA models more adaptable to dynamic physical environments.
VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation
arXiv:2610.12451v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as powerful foundations for robotic manipulation, but their reliance on fixed camera configurations during training makes them brittle to changes in camera count or pose during deployment. To overcome these limitations, we propose VersaCamVLA, a camera-configurable framework that decouples camera-set representation from action learning. VersaCamVLA learns a unified scene-token interface that maps an arbitrary, variable set of posed RGB views into fixed-size latent scene tokens. This is achieved via multi-signal target-view prediction and Wrist-Augmented Pose Sampling (WAPS), which leverages natural wrist-camera motion for free pose diversity. At deployment, a lightweight spatial encoder injects these compact scene tokens into a pretrained base VLA as a supplementary visual condition, requiring no explicit 3D sensing or novel-view rendering. Experiments on RoboTwin, LIBERO, and a real-robot platform demonstrate that VersaCamVLA consistently outperforms prior VLA methods and direct multi-view baselines, maintaining robust performance across varying camera counts and unseen camera poses.
Abstract:Vision-Language-Action (VLA) models have emerged as powerful foundations for robotic manipulation, but their reliance on fixed camera configurations during training makes them brittle to changes in camera count or pose during deployment. To overcome these limitations, we propose VersaCamVLA, a camera-configurable framework that decouples camera-set representation from action learning. VersaCamVLA learns a unified scene-token interface that maps an arbitrary, variable set of posed RGB views into fixed-size latent scene tokens. This is achieved via multi-signal target-view prediction and Wrist-Augmented Pose Sampling (WAPS), which leverages natural wrist-camera motion for free pose diversity. At deployment, a lightweight spatial encoder injects these compact scene tokens into a pretrained base VLA as a supplementary visual condition, requiring no explicit 3D sensing or novel-view rendering. Experiments on RoboTwin, LIBERO, and a real-robot platform demonstrate that VersaCamVLA consistently outperforms prior VLA methods and direct multi-view baselines, maintaining robust performance across varying camera counts and unseen camera poses.
Accepted at NeurIPS 2026. Project page: this https URL
Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
arXiv:2610.12451 [cs.CV]
(or arXiv:2610.12451v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.12451 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 259 cuvinte
Subiecte conexe

NVIDIA GTC Taipei at COMPUTEX: Live Updates on What’s Next in AI
NVIDIA · 21 mai 2026
VidAct: Learning Manipulation from In-the-Wild Videos with Object-Centric 3D Awareness
arXiv · 30 sept. 2026

Unlocking Sim2Real for a Robotic Arm with RL Accelerated by AMD Instinct GPUs
AMD · 29 sept. 2026

Post-Train NVIDIA Cosmos 3 Edge for On-Device Robot Control
NVIDIA · 19 aug. 2026