[go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Haptic Perception Research and Facility Design for Virtual Spaces

  • Conference paper
  • First Online:
Human-Computer Interaction (HCII 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14688))

Included in the following conference series:

  • 709 Accesses

Abstract

The goal of this study is to develop a smart device that can be used to enhance virtual space perception to improve the haptic perception experience of the user’s space in virtual training, entertainment, and other scenarios. Haptic feedback is one of the key elements to enhance the experience of virtual space perception. At present, virtual reality technology has been able to accomplish a considerable degree of ultra visual virtual field experience, such as simulating terrain, constructing haptic proxies with airbags to refine the virtual scene, but lack of research on longitudinal spatial haptics, passive opening of fixed haptic devices cannot meet the sensory needs of switching between different virtual spaces. In this study, the introduction of props of haptic proxies in the virtual space helps to enhance the virtual sensory experience of users. Through experiments and preliminary validation of user perception indicators, four design strategies for haptic proxies props in purely visual virtual contexts are proposed. Based on the design strategies, this paper designs an intelligent device for constructing an immersive virtual reality system, which assists users to interactively surrogate vision through haptic perception in virtual reality, and to more realistically feel the obstruction experience and spatial sense in virtual space. The device is installed on both sides of the experience space by two groups of forty 50 cm × 40 cm rectangular panels in total to meet the need for different sizes of obstructions in different scenarios, where each rectangular block can be actuated up to five depth levels (one depth actuation level for every 10 cm). Each panel is driven by a motorized actuator and moves the panel to the target displacement. The motors are powered by a power supply, driven by a motor driver, and controlled by an Arduino Uno that receives commands via serial communication from a host PC running a custom Unity application written in c#. The facilities and methods of this research have a wide range of application scenarios, which can provide a more realistic sense of experience for the design and development of virtual systems for spatial training classes with strict requirements for spatial perception; optimize the display effect and evaluation of virtual display of indoor decoration and home furnishing options; Enhance the spatial experience of virtual gaming categories, providing multi-dimensional haptic stimulation for immersive games such as virtual escape rooms. Provide multidimensional haptic and sensory stimulation. Future research can use the developed smart devices to further optimize the sensory feedback of visual-haptic synchronization in virtual space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Zhang, F.J., Dai, G.Z., Peng, X.L.: A review of human-computer interaction in virtual reality. Sci. China: Inf. Sci. 46(12), 1711–1736 (2016)

    Google Scholar 

  2. Theodoropoulos, A., Kougioumtzoglou, G., Lepouras, G.: A virtual ship evacuation serious game: assessment of data and passenger training. In: Kiili, K., Antti, K., de Rosa, F., Dindar, M., Kickmeier-Rust, M., Bellotti, F. (eds.) Games and Learning Alliance. GALA 2022. LNCS, vol. 13647, pp. 212–222. Springer, Cham (2022)

    Google Scholar 

  3. Liang, Z., Zhou, K., Gao, K.: Development of virtual reality serious game for underground rock-related hazards safety training. IEEE Access 7, 118639–118649 (2019). IEEE

    Google Scholar 

  4. Ricci, G., De Crescenzio, F., Santhosh, S., Magosso, E., Ursino, M.: Relationship between electroencephalographic data and comfort perception captured in a virtual reality design environment of an aircraft cabin. Sci. Rep. 12(1), 10938 (2022)

    Article  Google Scholar 

  5. Silvera, G., Biswas, A., Admoni, H.: DReye VR: democratizing virtual reality driving simulation for behavioural & interaction research. In: 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI) IEEE, pp. 639–643 (2022)

    Google Scholar 

  6. Qi, J., Gao, F., Sun, G., Yeo, J.C., Lim, C.T.: HaptGlove—untethered pneumatic glove for multimode haptic feedback in reality-virtuality continuum. Adv. Sci. 10(25), 2301044 (2023)

    Article  Google Scholar 

  7. Huang, H.Y., Ning, C.W., Wang, P.Y., Cheng, J.H., Cheng, L.P.: Haptic-go-round: a surrounding platform for encounter-type haptics in virtual reality experiences. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–10 (2020)

    Google Scholar 

  8. Chang, W., Je, S., Pahud, M., Sinclair, M., Bianchi, A.: Rendering perceived terrain stiffness in VR via preload variation against body-weight. IEEE Trans. Haptics 16(4), 616–621 (2023)

    Article  Google Scholar 

  9. Teng, S.Y., et al.: Tilepop: tile-type pop-up prop for virtual reality. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 639–649 (2019)

    Google Scholar 

  10. Cheng, L., et al.: Turkdeck: physical virtual reality based on people. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 417–426 (2015)

    Google Scholar 

  11. Yue, M.X., Xia, X.Y.: Types and characteristics of confined space accidents and application of new medical emergency rescue techniques. Chin. J. Injury Repair (Electron. Edn.) 8(03), 238–240 (2013)

    Google Scholar 

  12. Zhang, Q., Chang, N., Shang, K.: Design and exploration of virtual marine ship engine room system based on Unity3D platform. J. Intell. Fuzzy Syst. 38(2), 1241–1247 (2020)

    Article  Google Scholar 

  13. Liu, D.W., Jia, H.Y., Jian, Y.H., Qiu, F.K., Yan, H.: Construction and research of tunnel fire emergency training system based on virtual reality technology. China Safety Prod. Sci. Technol. 15(02), 131–137 (2019)

    Google Scholar 

  14. Hong, Y., Zhou, K.P., Liang, Z.P., Hu, Y.M.: Development of emergency training system for non-coal mine fire based on VR technology. Gold Sci. Technol. 27(04), 629–636 (2019)

    Google Scholar 

  15. Ren., Y.B.: Research on interface design and scale perception of underground streets based on virtual reality. China University of Mining and Technology (2020)

    Google Scholar 

  16. Zhang, J.L., Lang, C.L.: Simulation research of subway train fault repair based on VR equipment. Railroad Comput. Appl. 27(09), 21–24 (2018)

    Google Scholar 

  17. Tao, R., Zhu, Y.H., Ren, H.X., Guo, L.: Ship firefighting training system based on virtual reality technology. J. Shanghai Maritime Univ. 38(01), 74–78+94 (2017)

    Google Scholar 

  18. Lvov, M.S., Popova, H.V.: Simulation technologies of virtual reality usage in the training of future ship navigators (2019)

    Google Scholar 

  19. Lee, H.G., Chung, S., Lee, W.H.: Presence in virtual golf simulators: the effects of presence on perceived enjoyment, perceived value, and behavioral intention. New Media Soc. 15(6), 930–946 (2013)

    Article  Google Scholar 

  20. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  21. Jeon, J., Choi, S.: Haptic augmented reality: taxonomy and an example of stiffness modulation. Presence 18(5), 387–408 (2009)

    Google Scholar 

  22. Mullen, G., Davidenko, N.: Time compression in virtual reality. Timing Time Percept. 9(4), 377–392 (2021)

    Article  Google Scholar 

  23. Morikubo, Y., Lorenzo, E.S., Miyazaki, D., Hashimoto, N.: Tangible projection mapping: Dynamic appearance augmenting of objects in hands. In: SIGGRAPH Asia 2018 Emerging Technologies, pp. 1–2 (2018)

    Google Scholar 

  24. Asakawa, N., Wada, H., Shimomura, Y., Takasugi, K.: Development of VR tactile educational tool for visually impaired children: adaptation of optical motion capture as a tracker. Sens. Mater. 32(11), 3617 (2020)

    Google Scholar 

  25. Teng, S.Y., Li, P., Nith, R., Fonseca, J., Lopes, P.: Touch&Fold: a foldable haptic actuator for rendering touch in mixed reality. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2021)

    Google Scholar 

  26. Covaciu, F., Pisla, A., Iordan, A.E.: Development of a virtual reality simulator for an intelligent robotic system used in ankle rehabilitation. Sensors 21(4), 1537 (2021)

    Article  Google Scholar 

  27. De Tinguy, X., Pacchierotti, C., Marchal, M., Lécuyer, A.: Enhancing the stiffness perception of tangible objects in mixed reality using wearable haptics. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 81–90. IEEE (2018)

    Google Scholar 

  28. Culbertson, H., Schorr, S.B., Okamura, A.M.: Haptics: the present and future of artificial touch sensation. Annu. Rev. Control Robot. Autonom. Syst. 1, 385–409 (2018)

    Article  Google Scholar 

  29. Zou, L., Ge, C., Wang, Z.J., Cretu, E., Li, X.: Novel tactile sensor technology and smart tactile sensing systems: a review. Sensors 17(11), 2653 (2017)

    Article  Google Scholar 

  30. Kučera, E., Haffner, O., Kozák, Š.: Connection between 3D engine unity and microcontroller arduino: a virtual smart house. In: 2018 Cybernetics & Informatics (K&I), pp. 1–8. IEEE (2018)

    Google Scholar 

  31. Chatzitofis, A., Zarpalas, D., Daras, P., Kollias, S.: DeMoCap: low-cost marker-based motion capture. Int. J. Comput. Vision 129(12), 3338–3366 (2021)

    Article  Google Scholar 

  32. Shimada, S., Golyanik, V., Xu, W., Theobalt, C.: Physcap: physically plausible monocular 3d motion capture in real time. ACM Trans. Graph. 39(6), 1–16 (2020)

    Article  Google Scholar 

  33. Nilsson, N.C., Zenner, A., Simeone, A.L.: Propping up virtual reality with haptic proxies. IEEE Comput. Graph. Appl. 41(5), 104–112 (2021)

    Article  Google Scholar 

  34. Sra, M., Garrido-Jurado, S., Schmandt, C., Maes, P.: Procedurally generated virtual reality from 3D reconstructed physical space. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp. 191–200 (2016)

    Google Scholar 

  35. Je, S., et al.: Elevate: a walkable pin-array for large shape-changing terrains. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–11 (2021)

    Google Scholar 

  36. Je, S., et al.: Aero-plane: a handheld force-feedback device that renders weight motion illusion on a virtual 2d plane. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 763–775 (2019)

    Google Scholar 

  37. Cheng, L.P., Ofek, E., Holz, C., Benko, H., Wilson, A.D.: Sparse haptic proxy: touch feedback in virtual environments using a general passive prop. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 3718–3728 (2017)

    Google Scholar 

  38. Nagao, R., Matsumoto, K., Narumi, T., Tanikawa, T., Hirose, M.: Ascending and descending in virtual reality: simple and safe system using passive haptics. IEEE Trans. Visual Comput. Graph. 24(4), 1584–1593 (2018)

    Article  Google Scholar 

  39. Cheng, L.P., Chang, L., Marwecki, S., Baudisch, P.: iturk: turning passive haptics into active haptics by making users reconfigure props in virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–10 (2018)

    Google Scholar 

  40. Auda, J., Gruenefeld, U., Schneegass, S.: Enabling reusable haptic props for virtual reality by hand displacement. Proc. Mensch Comput. 2021, 412–417 (2021)

    Google Scholar 

  41. Suzuki, R., Nakayama, R., Liu, D., Kakehi, Y., Gross, M.D., Leithinger, D.: LiftTiles: constructive building blocks for prototyping room-scale shape-changing interfaces. In: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 143–151 (2020)

    Google Scholar 

Download references

Acknowledgments

This work was supported by R&D Program of Beijing Municipal Education Commission (SZ202211232025), “A Study of Emerging Groups and Design Strategies for Cultural Consumption in Beijing from the Perspective of Meaning Innovation”.

Author information

Authors and Affiliations

  1. Beijing Information Science and Technology University, Beijing, 100192, China

    Haoran Shi & Honghai Li

Authors
  1. Haoran Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Honghai Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Honghai Li .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  2. Hosei University, Tokyo, Japan

    Ayako Hashizume

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shi, H., Li, H. (2024). Haptic Perception Research and Facility Design for Virtual Spaces. In: Kurosu, M., Hashizume, A. (eds) Human-Computer Interaction. HCII 2024. Lecture Notes in Computer Science, vol 14688. Springer, Cham. https://doi.org/10.1007/978-3-031-60449-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-60449-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-60448-5

  • Online ISBN: 978-3-031-60449-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics