BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions

Abstract:Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often too complicated for children. We propose an interactive system that facilitates robot storytelling with tangible and natural language interactions. Children arrange the playground with their own stuff and create narratives with an LLM agent. The created narratives are transformed into a motion sequence based on the map and characters, and the motions are executed by self-navigating swarm robots. This system enhances robot storytelling with flexible scenarios, enabling young children to create robot dramas with everyday objects.

Robotics (cs.RO); Artificial Intelligence (cs.AI)

arXiv:2606.03223 [cs.RO]

(or arXiv:2606.03223v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2606.03223 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

https://doi.org/10.1109/VRW70859.2026.00227 Focus to learn more DOI(s) linking to related resources

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.