Skip to content
aiqbench takeAI Products

aiqbench analysis

This research advances human-robot collaboration by leveraging Large Language Models and computer vision to optimize tool handovers for asymmetric objects. The system dynamically adjusts robot orientation based on voice commands and gesture tracking, significantly reducing grasp delays while enhancing user trust in motion predictability.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Receiver-Centered Robot-to-Human Handover with Grasp-Aware Object Orientation

arXiv2 min read

arXiv:2607.17839v1 Announce Type: new Abstract: Collaborative robots are increasingly sharing workspaces with human operators, making tool handover a frequent and safety-critical micro-interaction. However, traditional static handovers often lead to awkward grasps when handling asymmetric industrial tools. This paper presents a receiver-centered voice-driven adaptive handover system for mechanical tools, built on a Franka cobot. Using an LLM for intention recognition and MediaPipe for real-time 3D hand tracking, the framework dynamically adjusts the end-effector's orientation to present tools in an ergonomically optimal, handle-first pose. A within-subjects study compared this adaptive approach with an object-agnostic static baseline. The results demonstrate that the adaptive system reduces the grasp delay for asymmetric tools, improving the fluency of the interaction. Furthermore, the adaptive strategy improved specific trust-related perceptions, particularly motion predictability and perceived task simplicity.

Abstract:Collaborative robots are increasingly sharing workspaces with human operators, making tool handover a frequent and safety-critical micro-interaction. However, traditional static handovers often lead to awkward grasps when handling asymmetric industrial tools. This paper presents a receiver-centered voice-driven adaptive handover system for mechanical tools, built on a Franka cobot. Using an LLM for intention recognition and MediaPipe for real-time 3D hand tracking, the framework dynamically adjusts the end-effector's orientation to present tools in an ergonomically optimal, handle-first pose. A within-subjects study compared this adaptive approach with an object-agnostic static baseline. The results demonstrate that the adaptive system reduces the grasp delay for asymmetric tools, improving the fluency of the interaction. Furthermore, the adaptive strategy improved specific trust-related perceptions, particularly motion predictability and perceived task simplicity.

Accepted for presentation at the 19th International Workshop on Human-Friendly Robotics (HFR 2026), Trento, Italy. The paper will appear in Springer's Proceedings in Advanced Robotics

Robotics (cs.RO)

arXiv:2607.17839 [cs.RO]

(or arXiv:2607.17839v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2607.17839 arXiv-issued DOI via DataCite (pending registration)

Full text under the publisher's open licence · 166 words

Related coverage