Abstract
Video see-through HMD mixes the real and virtual world, and users can have a good experience on virtual part, but the real part captured by cameras still have some problem, especially the distance perception. In this paper, we try to remove the error due to the distance between cameras and users. We use depth image-based rendering algorithm to re-compute the true distance of the scene, and render the correct image to the user. And we use multiple cameras with different viewpoints to reduce the occlusion areas.
In order to analyze the effect brought to the users, we implement the device with recent HMD and depth camera, and design an experiment to compare with human eyes and recent video see-through device.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
OVRVISION. http://ovrvision.com/entop/
AR-RIFT. http://willsteptoe.com/post/66968953089/ar-rift-part-1
Steptoe, W., Julier, S., Steed, A.: Presence and discernability in conventional and non-photorealistic immersive augmented reality. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE (2014)
Chen, S.E., Williams, L.: View interpolation for image synthesis. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. ACM (1993)
Zitnick, C.L., Kang, S.B. Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. ACM Transactions on Graphics (TOG), vol. 23, no. 3. ACM (2004)
Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. Electronic Imaging 2004. International Society for Optics and Photonics (2004)
Smolic, A., Muller, K., Dix, K., Merkle, P., Kauff, P., Wiegand, T.: Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems. In: 15th IEEE International Conference on Image Processing. IEEE (2008)
Ndjiki-Nya, P., Koppel, M., Doshkov, D., Lakshman, H., Merkle, P., Muller, K., Wiegand, T.: Depth image-based rendering with advanced texture synthesis for 3-D video. IEEE Trans. Multimedia 13(3), 453–465 (2011)
Zinger, S., Luat, D., de With, P.H.N.: Free-viewpoint depth image based rendering. J. Vis. Commun. Image Represent. 21(5), 533–541 (2010)
Lai, C.-J., Han, P.-H., Hung, Y.-P.: View interpolation for video see-through head-mounted display. In: ACM SIGGRApPH Posters. ACM (2016)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Garrido-Jurado, S., Muoz-Salinas, R., Madrid-Cuevas, F.J., Marn-Jimnez, M.J.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)
Garrido-Jurado, S., Muoz-Salinas, R., Madrid-Cuevas, F.J., Medina-Carnicer, R.: Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recogn. 51, 481–491 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Lai, CJ., Han, PH., Wang, HL., Hung, YP. (2017). Exploring Manipulation Behavior on Video See-Through Head-Mounted Display with View Interpolation. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10118. Springer, Cham. https://doi.org/10.1007/978-3-319-54526-4_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-54526-4_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54525-7
Online ISBN: 978-3-319-54526-4
eBook Packages: Computer ScienceComputer Science (R0)