Abstract
This paper investigates the effects of volumetrically filmed 3D characters on the audience’s sense of their presence in immersive interactive augmented reality (AR) narratives. After developing an interactive story with live actors and integrating the volumetrically filmed result into a HoloLens 2 application, we hypothesized that the perceived presence of these virtual characters in real space should be higher than 2D video holograms. In an AB/BA crossover design with 10 participants in each group, we compared the presence effects of the two alternatives in the designed AR play. We used the validated TPI questionnaire, observations, and post-experience interviews. Results show a rejection of the hypothesis that volumetric characters lead to better presence in general. While spatial presence was rated slightly better for 3D characters, social presence was superior for 2D videos. We discuss the results and limitations of the study and discuss lessons for future work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baños, R.M., Botella, C., Alcañiz, M., Liaño, V., Guerrero, B., Rey, B.: Immersion and emotion: their impact on the sense of presence. Cyberpsychol. Behav. 7(6), 734–741 (2004)
Bitter, J.L., Senk, G., Spierling, U.: Effects of volumetric video capture on interactive storytelling in immersive augmented reality: a short film experiment. In: 2023 the 7th International Conference on Virtual and Augmented Reality Simulations (ICVARS), March 03–05, 2023, Sydney, Australia, p. 7 pages. ACM, New York (2023). https://doi.org/10.1145/3603421.3603428
Bitter, J.L., Spierling, U.: Towards mobile holographic storytelling at historic sites. In: Brooks, E., Sjöberg, J., Møller, A.K. (eds.) Design, Learning, and Innovation, pp. 119–128. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-06675-7_9
Calvi, L.: What do we know about ar storytelling? In: Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, pp. 278–280 (2020)
Georgiou, Y., Kyza, E.A.: The development and validation of the ARI questionnaire: an instrument for measuring immersion in location-based augmented reality settings. Int. J. Hum Comput Stud. 98, 24–37 (2017)
Gödde, M., Gabler, F., Siegmund, D., Braun, A.: Cinematic narration in VR – rethinking film conventions for 360 degrees. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10910, pp. 184–201. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91584-5_15
Jennett, C., et al.: Measuring and defining the experience of immersion in games. Int. J. Hum. Comput. Stud. 66(9), 641–661 (2008)
Jin, Y., Ma, M., Zhu, Y.: A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimed. Tools Appl. 81(4), 5795–5826 (2022)
Koeck, R.: St George’s hall: If these walls could talk (2018)
Lombard, M., Ditton, T.B., Weinstein, L.: Measuring presence: the temple presence inventory. In: Proceedings of the 12th Annual International Workshop on Presence, pp. 1–15 (2009)
MacQuarrie, A., Steed, A.: Perception of volumetric characters’ eye-gaze direction in head-mounted displays. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 645–654 (2019). https://doi.org/10.1109/VR.2019.8797852
Martínez-Cano, J.: Volumetric filmmaking, new mediums and formats for digital audiovisual storytelling. AVANCA\(|\) CINEMA, pp. 606–614 (2020)
Marto, A., Gonçalves, A.: Augmented reality games and presence: a systematic review. J. Imaging 8(4), 91 (2022)
Moinnereau, M.A., de Oliveira Jr, A.A., Falk, T.H.: Immersive media experience: a survey of existing methods and tools for human influential factors assessment. Quality User Exp. 7(1), 5 (2022)
O’dwyer, N., Zerman, E., Young, G.W., Smolic, A., Dunne, S., Shenton, H.: Volumetric video in augmented reality applications for museological narratives: a user study for the long room in the library of trinity college dublin. J. Comput. Cult. Herit. 14(2), May 2021. https://doi.org/10.1145/3425400
Pianzola, F.: Presence, flow, and narrative absorption questionnaires: a scoping review. Open Res. Europe 1(11), 11 (2021)
Regenbrecht, H., Schubert, T.: Measuring presence in augmented reality environments: design and a first test of a questionnaire. arXiv preprint arXiv:2103.02831 (2021)
Ryan, R.M., Rigby, C.S., Przybylski, A.: The motivational pull of video games: a self-determination theory approach. Motiv. Emot. 30, 344–360 (2006)
Schreer, O., et al.: Preserving memories of contemporary witnesses using volumetric video. i-com 21(1), 71–82 (2022). https://doi.org/10.1515/icom-2022-0015
Schubert, T., Friedmann, F., Regenbrecht, H.: The experience of presence: factor analytic insights. Presence: Teleoperators Virtual Environ. 10(3), 266–281 (2001)
Smolic, A., et al.: Volumetric video content creation for immersive xr experiences (2022)
Sprung, G., Egger, A., Nischelwitzer, A.K., Strohmaier, R., Schadenbauer, S.: Virest-storytelling with volumetric videos. In: FMT, pp. 54–59 (2018)
Toet, A., Mioch, T., Gunkel, S.N., Niamut, O., van Erp, J.B.: Assessment of presence in augmented and mixed reality: Presence in augmented and mixed reality. In: Conference on Human Factors in Computing Systems, CHI 2021. ACM SigCHI (2021)
Vasconcelos-Raposo, J., Bessa, M., Teixeira, C.M., Cabral, L., Melo, M.: Adaptation and validation of the temple presence inventory in a Portuguese population. Int. J. Hum.-Comput. Inter. 35(6), 441–447 (2019)
Vorderer, P., et al.: MEC spatial presence questionnaire 18(2015), 6 (2004)
Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)
Yan, B., Ni, S., Wang, X., Liu, J., Zhang, Q., Peng, K.: Using virtual reality to validate the Chinese version of the independent television commission-sense of presence inventory. SAGE Open 10(2), 2158244020922878 (2020). https://doi.org/10.1177/2158244020922878
Zerman, E., O’Dwyer, N., Young, G.W., Smolic, A.: A case study on the use of volumetric video in augmented reality for cultural heritage. In: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, pp. 1–5 (2020)
Acknowledgment
We would like to thank Lorena Müller and Leonie Ferdinand, who supported us as actresses during the volumetric shooting. The research on presence has been supported by the LoGaCulture project, funded (in part) by the European Commission under grant agreement LoGaCulture (101094036).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bitter, J.L., Kräuter, N., Spierling, U. (2023). As If They Were Here: The Impact of Volumetric Video on Presence in Immersive Augmented Reality Storytelling. In: Holloway-Attaway, L., Murray, J.T. (eds) Interactive Storytelling. ICIDS 2023. Lecture Notes in Computer Science, vol 14383. Springer, Cham. https://doi.org/10.1007/978-3-031-47655-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-47655-6_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47654-9
Online ISBN: 978-3-031-47655-6
eBook Packages: Computer ScienceComputer Science (R0)