A Latency-Aware Framework for Visuomotor Policy Learning on Industrial Robots

Abstract:Industrial robots are increasingly deployed in construction and manufacturing tasks, where the deployment of end-to-end visuomotor policies is challenged by the observation-execution gap induced by observation, inference, and execution latencies. This gap is often significant on industrial robotic arms due to high-level control interfaces and slower closed-loop dynamics, making execution timing a dominant system-level concern. This paper presents a system-level, latency-aware framework for deploying and evaluating visuomotor policies on industrial robotic arms. The framework integrates latency-calibrated multimodal sensing, data synchronization, a unified communication pipeline, and a teleoperation interface for collecting expert demonstrations. Within this framework, we formalize a latency-aware execution strategy that assigns timestamps to policy-predicted action sequences and schedules only temporally feasible actions according to their intended execution time, enabling asynchronous inference and execution without modifying policy architectures or training procedures. We evaluate the framework on a contact-rich assembly task while systematically varying inference latency and compare latency-aware execution against blocking and naive asynchronous baselines using identical policies and sensing modalities. Results show that latency-aware execution preserves smooth motion, compliant contact behavior, and task progression consistent with demonstrations across inference latencies of 100-500 ms. Latency-aware execution maintained task duration and motion smoothness within 13% and 9% of the demonstration reference, respectively, while avoiding the latency-dependent slowdown observed under blocking execution and the large contact-force overshoots produced by naive asynchronous execution.

Robotics (cs.RO)

arXiv:2602.14255 [cs.RO]

(or arXiv:2602.14255v2 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2602.14255 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.