Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Generation of audiovisual immersive virtual environments to evaluate cognitive performance in classroom type scenarios
In the project ECoClass-VR, which is part of the AUDICTIVE priority programme, we investigate the suitability of audiovisual Immersive Virtual Environments (IVEs) for a “real-world” assessment of cognitive performance of adults and children in classroom-type environments under different visuospatial and acoustic conditions. Existing knowledge in this area comes predominantly from auditory experimental paradigms with typically simple acoustic replications. So far, only limited attention has been paid to visual processing, without considering relevant audiovisual aspects. In the project ECoClass-VR, it is planned to successively increase the realism of three existing psychological test paradigms that are first translated into audiovisual tasks and subsequently increased in terms of their realism with regard to cognitive tasks and IVEs. To do so, we use two different types of scene visualization: immersive 360° video, hence captured 360° video scenes and Computer Generated Imagery (CGI) based scenes generated by a software such as e.g. Unity. Within this paper, we present first results and explain how we captured and generated the corresponding IVEs. We describe the challenges as well as the technical solutions to achieve close-to-photorealism for two virtual representations of a classroom-type scene, and to enable the flexibility required for conducting the targeted cognitive performance tests.
Generation of audiovisual immersive virtual environments to evaluate cognitive performance in classroom type scenarios
In the project ECoClass-VR, which is part of the AUDICTIVE priority programme, we investigate the suitability of audiovisual Immersive Virtual Environments (IVEs) for a “real-world” assessment of cognitive performance of adults and children in classroom-type environments under different visuospatial and acoustic conditions. Existing knowledge in this area comes predominantly from auditory experimental paradigms with typically simple acoustic replications. So far, only limited attention has been paid to visual processing, without considering relevant audiovisual aspects. In the project ECoClass-VR, it is planned to successively increase the realism of three existing psychological test paradigms that are first translated into audiovisual tasks and subsequently increased in terms of their realism with regard to cognitive tasks and IVEs. To do so, we use two different types of scene visualization: immersive 360° video, hence captured 360° video scenes and Computer Generated Imagery (CGI) based scenes generated by a software such as e.g. Unity. Within this paper, we present first results and explain how we captured and generated the corresponding IVEs. We describe the challenges as well as the technical solutions to achieve close-to-photorealism for two virtual representations of a classroom-type scene, and to enable the flexibility required for conducting the targeted cognitive performance tests.
Generation of audiovisual immersive virtual environments to evaluate cognitive performance in classroom type scenarios
Fremerey, Stephan (Autor:in) / Reimers, Carolin (Autor:in) / Leist, Larissa (Autor:in) / Spilski, Jan (Autor:in) / Klatte, Maria (Autor:in) / Fels, Janina (Autor:in) / Raake, Alexander (Autor:in) / Thüringer Universitäts- Und Landesbibliothek Jena (Gastgebende Institution)
2021
Tagungsband - DAGA 2021: 47. Jahrestagung für Akustik : 15.-18. August 2021, Wien und Online : Tagungsband der DAGA 2021, p. 1336
Sonstige
Elektronische Ressource
Englisch
Spatial Understanding in Immersive Virtual Environments
SAGE Publications | 2003
|Europäisches Patentamt | 2017
|The architectural conception drawing in immersive virtual environments
Taylor & Francis Verlag | 2024
|Spatial Perception Assessment in Immersive Virtual Environments. A Methodological Approach
Springer Verlag | 2022
|