SERMAS, socially acceptable extended reality models and systems

OUR SOLUTION

The research focuses on three pilots developed by two project partners: Deutsche Welle and Poste Italiane. These pilots are complementary and represent different XR features: Pilot 1 – Artificial Security Agent : a solution with an advanced XR-based interaction to enable tailored and practical training for diverse types of journalists in situations where they might encounter dangerous scenarios. It will be introduced virtual, partially AI-driven XR assistants and socially acceptable avatars to support human trainers. The security agent for journalists is a digital co-trainer that can be on the spot within minutes. Pilot 2 – Post Office Agent : Poste Italiane will install one or more XR systems for customer reception at post offices to interact with customers in conversational mode and help them carry out the operations they need. The XR system provides a face-to-face friendly connection, using effective communication combining touch and voice. By recognising the user within a predefined cluster, the Post Office Agent behaves and implements a personalised conversation according to the type of user in front of them. Pilot 3 – Receptionist Agent : SERMAS will develop an XR system to work as a Receptionist Agent and assist users by providing a series of services like granting physical access to the company offices or giving general information. The Receptionist agent detects the user’s presence and automatically starts interacting based on the user’s movement.