Empowering End-User in Creating eXtended Reality Content with a Conversational Chatbot

Mereu, Jacopo;Artizzu, Valentino;Carcangiu, Alessandro;Spano, Lucio Davide;Simeoli, Ludovica;Mattioli, Andrea;Manca, Marco;Santoro, Carmen;Paternò, Fabio

2025-01-01

---

Abstract

Recent advancements in eXtended Reality (XR) technologies have found application across diverse domains. However, creating complex interactions within XR environments remains challenging for non-technical users. In this work, we present EUD4XR, a project aiming to: i) empower end-user developers (EUDevs) to customize XR environments by supporting virtual objects and physical devices; ii) involve an intelligent conversational agent which assists the user in defining behaviours. The agent can handle multimodal input, to drive the EUDev during the rule authoring process, using contextual knowledge of the virtual environment and its elements. By integrating conversational assistance, EUD4XR seeks to lower further the usage barriers for end-users to personalize XR experiences according to their needs.