Sari la conținut
aiqbenchInformații despre AI & calcul cuantic
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre
...Se încarcă sesiunea
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

Înapoi la listă
perspectiva aiqbenchCercetare AI

analiza aiqbench

This study tests whether an autonomous social robot that fuses speech, vision, and touch can match a human-teleoperated baseline in a VR setting. It falls short on naturalness and social appropriateness, and the authors point to conversational timing, clarifying ambiguous requests, and spatial coordination as the main gaps. For AI readers, the useful signal is the benchmark-style comparison against human operators, which shows where multimodal interaction still lags human performance.
1
Sursă care acoperăarXiv

Multimodal Socially Aware Framework for Human-Robot Interaction in Virtual Reality

arXiv·27 octombrie 2026·2 min de citit·Articolul și perspectiva sunt în engleză.

De la arXiv

Text integral

arXiv:2610.34534v1 Announce Type: new Abstract: Social robots must coordinate speech and movement while interpreting multimodal human input. We present a multimodal framework that integrates speech, vision, and touch to generate contextually appropriate robot speech and movement. We evaluated the framework in virtual reality with 18 participants across five social interaction scenarios, comparing its performance against a human-teleoperated baseline. Although participants rated the autonomous system above the neutral midpoint for both naturalness and social appropriateness, the teleoperated baseline received significantly higher ratings on both measures.

Behavioral coding and qualitative feedback revealed that conversational timing, clarification of ambiguous requests, and spatial coordination were important factors contributing to this performance gap. These findings highlight key challenges in developing autonomous robots capable of natural, multimodal social interaction.

Abstract:Social robots must coordinate speech and movement while interpreting multimodal human input. We present a multimodal framework that integrates speech, vision, and touch to generate contextually appropriate robot speech and movement. We evaluated the framework in virtual reality with 18 participants across five social interaction scenarios, comparing its performance against a human-teleoperated baseline. Although participants rated the autonomous system above the neutral midpoint for both naturalness and social appropriateness, the teleoperated baseline received significantly higher ratings on both measures.

Behavioral coding and qualitative feedback revealed that conversational timing, clarification of ambiguous requests, and spatial coordination were important factors contributing to this performance gap. These findings highlight key challenges in developing autonomous robots capable of natural, multimodal social interaction.

Robotics (cs.RO)

arXiv:2610.34534 [cs.RO]

(or arXiv:2610.34534v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2610.34534 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Text integral sub licența deschisă a publicației · 211 cuvinte

Citește pe arXiv ↗Întreabă despre acest articol

Subiecte conexe

Machine learning

Information-Theoretic Decomposition for Multimodal Interaction Learning

arXiv · 12 iun. 2026

Cercetare AI

DIVE: Benchmarking Full-Duplex Interaction with Visual Engagement in Continuous Streams

arXiv · 21 oct. 2026

Machine learning

Multimodal Information Interactions Bottleneck for Multimodal Self-Supervised Learning

arXiv · 6 nov. 2026

Machine learning

MIME: Multimodal Interactive Motion Encoder

arXiv · 28 iul. 2026

Article info

Source

arXiv

Published

27 octombrie 2026

Read time

2 min

Category

Cercetare AI
aiqbench
Informații despre AI & calcul cuantic© aiqbench. Toate drepturile rezervate.

Fluxuri:RSS·JSON Feed

LimbăEnglish·Românăbeta
ȘtiriAI & tehnologieCuanticAnalize
ExploreazăBenchmark-uriÎnvață
CompanieDespreÎncredereInformații legaleTermeni și condițiiPolitica de confidențialitateNotificări privind drepturile de autorȘtergerea datelorRaportează conținut

Perspectiva aiqbench, analizele, rezumatul zilnic și răspunsurile din Întreabă sunt scrise de modele AI din sursele afișate, fără revizuire editorială înainte de publicare. Pot conține erori — verifică sursa. Cum este folosit modelul →

  • Știri
  • Analize
  • Întreabă
  • Topuri
  • Cont