research-article

Open access

Bodylab: in virtuo sculpting, painting and performing of full-body avatars

Authors:

Daniel Zeidler,

Matthew McGinityAuthors Info & Claims

Proceedings of the ACM on Computer Graphics and Interactive Techniques, Volume 6, Issue 2

Article No.: 22, Pages 1 - 12

https://doi.org/10.1145/3597631

Published: 16 August 2023 Publication History

All formats PDF

Abstract

Bodylab is a virtual reality system for creating full-body virtual reality avatars. It provides anatomically realistic mannequins as canvases, which can be painted and textured, sculpted and deformed, adorned with objects and animated with particle effects. The artist can work from a first or third person perspective, and variety of interaction modalities are made available. To assess the system, we invite costume designers and theatrical artists to provide expert reviews. We also describe the use of Bodylab in a live dance performance. We believe Bodylab to be the first virtual reality tool for in virtuo painting and sculpting of full-body avatars.

References

[1]

Norman I Badler and Mary Ann Morris. 1982. Modelling flexible articulated objects. In Proc. Computer Graphics' 82, Online Conf. 305--314.

[2]

Philippe Bertrand, Jérôme Guegan, Léonore Robieux, Cade Andrew McCall, and Franck Zenasni. 2018. Learning Empathy Through Virtual Reality: Multiple Strategies for Training Empathy-Related Abilities Using Body Ownership Illusions in Embodied Virtual Reality. Frontiers in Robotics and AI 5 (2018). https://doi.org/10.3389/frobt.2018.00026

[3]

Frank Biocca. 1999. The cyborg's dilemma: Progressive embodiment in virtual environments. Human Factors in Information Technology 13 (1999), 113--144.

[4]

Elen Collaço De Oliveira, Philippe Bertrand, Marte Ernesto Roel Lesur, Priscila Palomo, Marcelo Demarzo, Ausias Cebolla, Rosa Baños, and Romero Tori. 2016. Virtual Body Swap: A New Feasible Tool to Be Explored in Health and Education. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR). 81--89. https://doi.org/10.1109/SVR.2016.23

[5]

Sevinc Eroglu, Sascha Gebhardt, Patric Schmitz, Dominik Rausch, and Torsten Wolfgang Kuhlen. 2018. Fluid Sketching---Immersive Sketching Based on Fluid Flow. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 475--482. https://doi.org/10.1109/VR.2018.8446595

[6]

Arnulph Fuhrmann, Gerrit Sobotka, and Clemens Gross. 2003. Distance Fields for Rapid Collision Detection in Physically Based Modeling. In Proceedings of GraphiCon 2003. 58--65.

[7]

Guilherme Gonçalves, Miguel Melo, Luís Barbosa, José Vasconcelos-Raposo, and Maximino Bessa. 2021. Evaluation of the impact of different levels of self-representation and body tracking on the sense of presence and embodiment in immersive VR. Virtual Reality (2021). https://doi.org/10.1007/s10055-021-00530-5

Digital Library

[8]

Hunter G. Hoffman. 2021. Interacting with virtual objects via embodied avatar hands reduces pain intensity and diverts attention. Scientific reports 11, 1 (2021), 10672. https://doi.org/10.1038/s41598-021-89526-4

[9]

Björn van der Hoort, Arvid Guterstam, and H. Henrik Ehrsson. 2011. Being Barbie: The Size of One's Own Body Determines the Perceived Size of the World. PLoS ONE 6, 5 (May 2011), e20195. https://doi.org/10.1371/journal.pone.0020195

[10]

Shengzhe Hou, Bruce H. Thomas, and Xinming Lu. 2021. VRMenuDesigner: A toolkit for automatically generating and modifying VR menus. https://doi.org/10.1109/AIVR52153.2021.00036

[11]

Ryota Ito, Nami Ogawa, Takuji Narumi, and Michitaka Hirose. 2019. Do We Have to Look at the Mirror All the Time? Effect of Partial Visuomotor Feedback on Body Ownership of a Virtual Human Tail. In ACM Symposium on Applied Perception 2019 (ACM Digital Library), Solène Neyret (Ed.). Association for Computing Machinery, New York,NY,United States, 1--9. https://doi.org/10.1145/3343036.3343139

Digital Library

[12]

Jamil Joundi, Yannick Christiaens, Jelle Saldien, Peter Conradie, and Lieven Marez. 2020. An Explorative Study Towards Using Vr Sketching As A Tool For Ideation And Prototyping In Product Design. 16th International DESIGN Conference 1 (2020), 225--234. https://doi.org/10.1017/dsd.2020.61

[13]

Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments 21, 4 (Nov. 2012), 373--387. https://doi.org/10.1162/PRES_a_00124

Digital Library

[14]

Martin Kocur, Melanie Kloss, Valentin Schwind, Christian Wolff, and Niels Henze. 2020a. Flexing Muscles in Virtual Reality: Effects of Avatars' Muscular Appearance on Physical Performance. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, New York, NY, USA, 193--205. https://doi.org/10.1145/3410404.3414261

Digital Library

[15]

Martin Kocur, Philipp Schauhuber, Valentin Schwind, Christian Wolff, and Niels Henze. 2020b. The Effects of Self- and External Perception of Avatars on Cognitive Task Performance in Virtual Reality. In 26th ACM Symposium on Virtual Reality Software and Technology. ACM, New York, NY, USA, 1--11. https://doi.org/10.1145/3385956.3418969

Digital Library

[16]

Andrey Krekhov, Sebastian Cmentowski, Katharina Emmerich, and Jens Krüger. 2019. Beyond Human. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, New York, NY, USA, 439--451. https://doi.org/10.1145/3311350.3347172

Digital Library

[17]

Jaron Lanier. 2006. Homuncular flexibility. Edge: The World Question Center (2006).

[18]

J. P. Lewis, Matt Cordner, and Nickson Fong. 2000. Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., USA, 165--172. https://doi.org/10.1145/344779.344862

Digital Library

[19]

Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graph. 34, 6, Article 248 (nov 2015), 16 pages. https://doi.org/10.1145/2816795.2818013

Digital Library

[20]

Ke Ma, Roberta Sellaro, and Bernhard Hommel. 2019. Personality assimilation across species: enfacing an ape reduces own intelligence and increases emotion attribution to apes. Psychological research 83, 2 (2019), 373--383. https://doi.org/10.1007/s00426-018-1048-x

[21]

Nadia Magnenat-Thalmann, Richard Laperrire, and Daniel Thalmann. 1988. Joint-dependent local deformations for hand animation and object grasping. In In Proceedings on Graphics interface'88. Citeseer.

[22]

Antonella Maselli and Mel Slater. 2013. The building blocks of the full body ownership illusion. Frontiers in human neuroscience 7 (2013), 83. https://doi.org/10.3389/fnhum.2013.00083

[23]

Ramon Oliva, Alejandro Beacco, Xavi Navarro, and Mel Slater. 2022. QuickVR: A standard library for virtual embodiment in unity. Frontiers in Virtual Reality 3 (2022), 128. https://doi.org/10.3389/frvir.2022.937191

[24]

Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, and Michael J. Black. 2019. Expressive Body Capture: 3D Hands, Face, and Body from a Single Image.

[25]

Sergi Pujades, Betty Mohler, Anne Thaler, Joachim Tesch, Naureen Mahmood, Nikolas Hesse, Heinrich H. Bulthoff, and Michael J. Black. 2019. The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from 3D Measurements. IEEE transactions on visualization and computer graphics 25, 5 (2019), 1887--1897. https://doi.org/10.1109/TVCG.2019.2898748

[26]

Sebastian Starke, He Zhang, Taku Komura, and Jun Saito. 2019. Neural state machine for character-scene interactions. ACM Transactions on Graphics 38, 6 (2019), 1--14. https://doi.org/10.1145/3355089.3356505

Digital Library

[27]

Fabian Unruh, Maximilian Landeck, Sebastian Oberdörfer, Jean-Luc Lugrin, and Marc Erich Latoschik. 2021. The Influence of Avatar Embodiment on Time Perception - Towards VR for Time-Based Therapy. Frontiers in Virtual Reality 2 (2021). https://doi.org/10.3389/frvir.2021.658509

[28]

Victor Turner. 1964. Betwixt and Between. The Liminal Period in Rites de Passage. Proceedings of the 1964 Annual Spring Meeting of the American Ethnological Association (1964), 4--20.

[29]

VIVE. 2023. How many SteamVR Base Stations 2.0 can I use in a single setup? https://www.vive.com/uk/support/vive-pro2/category_howto/how-many-base-stations-can-i-use.html

[30]

Eun Kyoung Yang and Jee Hyun Lee. 2020. Cognitive impact of virtual reality sketching on designers' concept generation. Digital Creativity 31, 2 (2020), 82--97. https://doi.org/10.1080/14626268.2020.1726964

[31]

Milica Zec and Winslow Porter. 2017. Tree. https://www.treeofficial.com/

[32]

Magdalena Żuk, Magdalena Wojtków, Michał Popek, Jakub Mazur, and Katarzyna Bulińska. 2022. Three-dimensional gait analysis using a virtual reality tracking system. Measurement 188 (2022), 110627. https://doi.org/10.1016/j.measurement.2021.110627

Cited By

Zhu XYang Y(2024)Interactive Mesh Sculpting with Arbitrary Topologies in Head-Mounted VR EnvironmentsMathematics10.3390/math1215242812:15(2428)Online publication date: 5-Aug-2024
https://doi.org/10.3390/math12152428
Bruggisser FLeisi CLund-Jensen PFröhlich MSalter C(2024)reconFIGURE: Confronting Audiences with Digital DoppelgängersProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36642087:4(1-10)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3664208

Index Terms

Bodylab: in virtuo sculpting, painting and performing of full-body avatars
1. Applied computing
  1. Arts and humanities
    1. Media arts
    2. Performing arts
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality Interaction
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing Systems
Immersive Virtual Reality typically requires a head-mounted display (HMD) to visualize the environment and hand-held controllers to interact with the virtual objects. Recently, many applications display full-body avatars to represent the user and animate ...
Virtual Dance Mirror: A Functional Approach to Avatar Representation through Movement in Immersive VR
MOCO '22: Proceedings of the 8th International Conference on Movement and Computing

Immersive Virtual Reality (VR) technologies offer new possibilities for studying embodied interaction with different sets of constraints and affordances for action-taking while using one’s physical body. In this study, we designed and prototyped a VR ...
The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

This paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques

Proceedings of the ACM on Computer Graphics and Interactive Techniques Volume 6, Issue 2

August 2023

126 pages

EISSN:2577-6193

DOI:10.1145/3616531

Issue’s Table of Contents

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2023

Published in PACMCGIT Volume 6, Issue 2

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
407
Total Downloads

Downloads (Last 12 months)357
Downloads (Last 6 weeks)35

Reflects downloads up to 10 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu XYang Y(2024)Interactive Mesh Sculpting with Arbitrary Topologies in Head-Mounted VR EnvironmentsMathematics10.3390/math1215242812:15(2428)Online publication date: 5-Aug-2024
https://doi.org/10.3390/math12152428
Bruggisser FLeisi CLund-Jensen PFröhlich MSalter C(2024)reconFIGURE: Confronting Audiences with Digital DoppelgängersProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36642087:4(1-10)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3664208

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents