Abstract
This paper proposes methods for tracking a bare hand with a near-range depth camera attached to a video see-through Head-mounted Display (HMD) for virtual object manipulation in an Augmented Reality (AR) environment. The particular focus herein is upon using hand gestures that are frequently used in daily life. First, we use a near-range depth camera attached to HMD to segment the hand object easily, considering both skin color and depth information within arms’ reaches. Then, fingertip and base positions are extracted through primitive models of the finger and palm. According to these positions, the rotation parameters of finger joints are estimated through an inverse-kinematics algorithm. Finally, the user’s hands are localized from physical space by camera-tracking and then used for 3D virtual object manipulation. Our method is applicable to various AR interaction scenarios such as digital information access/control, creative CG modeling, virtual-hand-guiding, or game UIs.
Chapter PDF
Similar content being viewed by others
References
Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3D tracking of hand articulations using Kinect. In: Proceedings of the 22nd British Machine Vision Conference, BMVC 2011, University of Dundee, UK, August 29-September 1 (2011)
Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Tracking the articulated motion of two strongly interacting hands. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, Rhode Island, USA, June 18-20 (2012)
Wang, R.Y., Popovic, J.: Real-Time Hand-Tracking with a Color Glove. ACM Transaction on Graphics (SIGGRAPH 2009) 28(3) (August 2009)
Wang, R.Y., Paris, S., Popovic, J.: 6D Hands: Markerless Hand Tracking for Computer Aided Design. ACM User Interface Software and Technology, UIST (2011)
Coleca, F., Klement, S., Martinetz, T., Barth, E.: Real-time skeleton tracking for embedded systems. In: Proceedings SPIE, Mobile Computational Photography, vol. 8667D (2013)
LEAP MOTION, https://www.leapmotion.com (access date: February 5, 2014)
Wachs, J., Kölsch, M., Stern, H., Edan, Y.: Vision-Based Hand-Gesture Applications, Challenges and Innovations. Communications of the ACM (February 2011)
Lee, T., Höllerer, T.: Handy AR:Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking. In: Proceedings of the IEEE International Symposium on Werarable Computer(ISWC), Boston, MA (October 2007)
SOFT KINETIC, http://www.softkinetic.com (access date: February 5, 2014)
Albrecht, I., Haber, J., Seidel, H.-P.: Construction and Animation of Anatomically Based Human Hand Models. In: Eurographics Symposium on Computer Animation, p. 109. Eurographics Association (2003)
Ram Rajesh, J., Nagarjunan, D., Arunachalam, M., Aarthi, R.R.: Distance Transform Based Hand Gestures Recognition for Powerpoint Presentation Navigation. Advanced Computing 3(3), 41 (2012)
Wampler, C.W., Leifer, L.J.: Applications of damped least-squares methods to resolved-rate and resolved-acceleration control of manipulators. Journal of Dynamic Systems, Measurement, and Control 110, 31–38 (1988)
Ha, T., Woo, W.: Bare hand interface for interaction in the video see-through HMD based wearable AR environment. In: Harper, R., Rauterberg, M., Combetto, M. (eds.) ICEC 2006. LNCS, vol. 4161, pp. 354–357. Springer, Heidelberg (2006)
Brunelli, R.: Template Matching Techniques in Computer Vision: Theory and Practice. Wiley
SIXENSE, http://sixense.com/ (access date: February 5, 2014)
Unity3D, http://unity3d.com (access date: February 5, 2014)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Park, G., Ha, T., Woo, W. (2014). Hand Tracking with a Near-Range Depth Camera for Virtual Object Manipulation in an Wearable Augmented Reality. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_37
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)