Towards Multimodal VR Trainer of Voice Emission and Public Speaking: Work-in-Progress


Type
Conference Object
Change log
Authors
Igras-Cybulska, Magdalena 
Hekiert, Daniela 
Cybulski, Artur 
Witkowski, Marcin 
Abstract

GlossoVR is a virtual reality (VR) application that combines training in public speaking in front of a virtual audience and in voice emission in relaxation exercises. It is accompanied by digital signal processing (DSP) and artificial intelligence (AI) modules which provide automatic feedback on the vocal performance as well as the behavior and psychophysiology of the user. In particular, we address parameters of speech emotions, prosody and timbre, and the user's hand gestures and eye movement. The prototype is in the proof of concept phase, and we are developing it in accordance with the user-centered design paradigm. In this article reports the work in progress, focusing on the approaches, datasets and algorithms applied in the current state of the glossoVR project.

Description
Keywords
Journal Title
Conference Name
2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Journal ISSN
Volume Title
Publisher
Publisher DOI
Publisher URL
Sponsorship
This work was supported by program Lider grant no 0230/L-11/2019 by the National Center for Research and Development, Poland.