[go: up one dir, main page]

Skip to main content

As If They Were Here: The Impact of Volumetric Video on Presence in Immersive Augmented Reality Storytelling

  • Conference paper
  • First Online:
Interactive Storytelling (ICIDS 2023)

Abstract

This paper investigates the effects of volumetrically filmed 3D characters on the audience’s sense of their presence in immersive interactive augmented reality (AR) narratives. After developing an interactive story with live actors and integrating the volumetrically filmed result into a HoloLens 2 application, we hypothesized that the perceived presence of these virtual characters in real space should be higher than 2D video holograms. In an AB/BA crossover design with 10 participants in each group, we compared the presence effects of the two alternatives in the designed AR play. We used the validated TPI questionnaire, observations, and post-experience interviews. Results show a rejection of the hypothesis that volumetric characters lead to better presence in general. While spatial presence was rated slightly better for 3D characters, social presence was superior for 2D videos. We discuss the results and limitations of the study and discuss lessons for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Baños, R.M., Botella, C., Alcañiz, M., Liaño, V., Guerrero, B., Rey, B.: Immersion and emotion: their impact on the sense of presence. Cyberpsychol. Behav. 7(6), 734–741 (2004)

    Article  Google Scholar 

  2. Bitter, J.L., Senk, G., Spierling, U.: Effects of volumetric video capture on interactive storytelling in immersive augmented reality: a short film experiment. In: 2023 the 7th International Conference on Virtual and Augmented Reality Simulations (ICVARS), March 03–05, 2023, Sydney, Australia, p. 7 pages. ACM, New York (2023). https://doi.org/10.1145/3603421.3603428

  3. Bitter, J.L., Spierling, U.: Towards mobile holographic storytelling at historic sites. In: Brooks, E., Sjöberg, J., Møller, A.K. (eds.) Design, Learning, and Innovation, pp. 119–128. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-06675-7_9

  4. Calvi, L.: What do we know about ar storytelling? In: Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, pp. 278–280 (2020)

    Google Scholar 

  5. Georgiou, Y., Kyza, E.A.: The development and validation of the ARI questionnaire: an instrument for measuring immersion in location-based augmented reality settings. Int. J. Hum Comput Stud. 98, 24–37 (2017)

    Article  Google Scholar 

  6. Gödde, M., Gabler, F., Siegmund, D., Braun, A.: Cinematic narration in VR rethinking film conventions for 360 degrees. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10910, pp. 184–201. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91584-5_15

    Chapter  Google Scholar 

  7. Jennett, C., et al.: Measuring and defining the experience of immersion in games. Int. J. Hum. Comput. Stud. 66(9), 641–661 (2008)

    Article  Google Scholar 

  8. Jin, Y., Ma, M., Zhu, Y.: A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimed. Tools Appl. 81(4), 5795–5826 (2022)

    Article  Google Scholar 

  9. Koeck, R.: St George’s hall: If these walls could talk (2018)

    Google Scholar 

  10. Lombard, M., Ditton, T.B., Weinstein, L.: Measuring presence: the temple presence inventory. In: Proceedings of the 12th Annual International Workshop on Presence, pp. 1–15 (2009)

    Google Scholar 

  11. MacQuarrie, A., Steed, A.: Perception of volumetric characters’ eye-gaze direction in head-mounted displays. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 645–654 (2019). https://doi.org/10.1109/VR.2019.8797852

  12. Martínez-Cano, J.: Volumetric filmmaking, new mediums and formats for digital audiovisual storytelling. AVANCA\(|\) CINEMA, pp. 606–614 (2020)

    Google Scholar 

  13. Marto, A., Gonçalves, A.: Augmented reality games and presence: a systematic review. J. Imaging 8(4), 91 (2022)

    Article  Google Scholar 

  14. Moinnereau, M.A., de Oliveira Jr, A.A., Falk, T.H.: Immersive media experience: a survey of existing methods and tools for human influential factors assessment. Quality User Exp. 7(1), 5 (2022)

    Article  Google Scholar 

  15. O’dwyer, N., Zerman, E., Young, G.W., Smolic, A., Dunne, S., Shenton, H.: Volumetric video in augmented reality applications for museological narratives: a user study for the long room in the library of trinity college dublin. J. Comput. Cult. Herit. 14(2), May 2021. https://doi.org/10.1145/3425400

  16. Pianzola, F.: Presence, flow, and narrative absorption questionnaires: a scoping review. Open Res. Europe 1(11), 11 (2021)

    Article  Google Scholar 

  17. Regenbrecht, H., Schubert, T.: Measuring presence in augmented reality environments: design and a first test of a questionnaire. arXiv preprint arXiv:2103.02831 (2021)

  18. Ryan, R.M., Rigby, C.S., Przybylski, A.: The motivational pull of video games: a self-determination theory approach. Motiv. Emot. 30, 344–360 (2006)

    Article  Google Scholar 

  19. Schreer, O., et al.: Preserving memories of contemporary witnesses using volumetric video. i-com 21(1), 71–82 (2022). https://doi.org/10.1515/icom-2022-0015

  20. Schubert, T., Friedmann, F., Regenbrecht, H.: The experience of presence: factor analytic insights. Presence: Teleoperators Virtual Environ. 10(3), 266–281 (2001)

    Google Scholar 

  21. Smolic, A., et al.: Volumetric video content creation for immersive xr experiences (2022)

    Google Scholar 

  22. Sprung, G., Egger, A., Nischelwitzer, A.K., Strohmaier, R., Schadenbauer, S.: Virest-storytelling with volumetric videos. In: FMT, pp. 54–59 (2018)

    Google Scholar 

  23. Toet, A., Mioch, T., Gunkel, S.N., Niamut, O., van Erp, J.B.: Assessment of presence in augmented and mixed reality: Presence in augmented and mixed reality. In: Conference on Human Factors in Computing Systems, CHI 2021. ACM SigCHI (2021)

    Google Scholar 

  24. Vasconcelos-Raposo, J., Bessa, M., Teixeira, C.M., Cabral, L., Melo, M.: Adaptation and validation of the temple presence inventory in a Portuguese population. Int. J. Hum.-Comput. Inter. 35(6), 441–447 (2019)

    Article  Google Scholar 

  25. Vorderer, P., et al.: MEC spatial presence questionnaire 18(2015), 6 (2004)

    Google Scholar 

  26. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)

    Article  Google Scholar 

  27. Yan, B., Ni, S., Wang, X., Liu, J., Zhang, Q., Peng, K.: Using virtual reality to validate the Chinese version of the independent television commission-sense of presence inventory. SAGE Open 10(2), 2158244020922878 (2020). https://doi.org/10.1177/2158244020922878

  28. Zerman, E., O’Dwyer, N., Young, G.W., Smolic, A.: A case study on the use of volumetric video in augmented reality for cultural heritage. In: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, pp. 1–5 (2020)

    Google Scholar 

Download references

Acknowledgment

We would like to thank Lorena Müller and Leonie Ferdinand, who supported us as actresses during the volumetric shooting. The research on presence has been supported by the LoGaCulture project, funded (in part) by the European Commission under grant agreement LoGaCulture (101094036).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jessica L. Bitter .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bitter, J.L., Kräuter, N., Spierling, U. (2023). As If They Were Here: The Impact of Volumetric Video on Presence in Immersive Augmented Reality Storytelling. In: Holloway-Attaway, L., Murray, J.T. (eds) Interactive Storytelling. ICIDS 2023. Lecture Notes in Computer Science, vol 14383. Springer, Cham. https://doi.org/10.1007/978-3-031-47655-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47655-6_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47654-9

  • Online ISBN: 978-3-031-47655-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics