[go: up one dir, main page]

Skip to main content

Lightweight Deep Learning Models for Robust Hand Gesture Recognition

  • Conference paper
  • First Online:
Advances in Information Communication Technology and Computing (AICTC 2024)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 1075))

  • 83 Accesses

Abstract

Hand gesture recognition is a burgeoning area of study with wide-ranging applications, including human–computer interaction, sign language translation, and virtual reality control. In this work, we introduce an innovative lightweight DL model designed for robust HGR and provide an in-depth analysis of its classification performance. We meticulously evaluate key performance metrics such as precision, detection rate, Jaccard index, and false positive rate and compare these results with existing methodologies. Our proposed model stands out by surpassing the performance of current models. It exhibits higher accuracy rates during both training and validation, a substantially improved detection rate, and an almost perfect Jaccard index. Most impressively, our model achieves a remarkable false positive rate of zero, showcasing its exceptional reliability in distinguishing between positive and negative instances. These findings underscore the effectiveness of our approach in addressing challenges related to overlapping gestures, unbalanced class distributions, and precise HGR. In our conclusion, we identify areas for potential enhancement and further research. To clarify the novelty and research gap of our proposed model, we emphasise its lightweight nature and articulate how it differs from existing methods. This distinction lies in its capacity to deliver accurate and efficient HGR while imposing minimal computational burden, setting it apart from more resource-intensive approaches. In summary, our study and potential to revolutionise practical applications that demand dependable and effective hand gesture recognition systems, bridging existing gaps in the area.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 199.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kevin MS, Gupta IM, Rajendran IM (2023) Hand gesture recognition (unveiling the power of nonverbal communication through literature review). Int J Eng Res Technol (IJERT) 12(3)

    Google Scholar 

  2. Karray F, Alemzadeh M, Abou Saleh J, Arab MN (2008) Human computer interaction. overview on state of the art. Int J Smart Sens Intell Syst 1(1)

    Google Scholar 

  3. Hasan MM, Misra PK (2011) Brightness factor matching for gesture recognition system using scaled normalization. Int J Comput Sci Inf Technol (IJCSIT) 3(2)

    Google Scholar 

  4. Dunne RA, Campbell NA (1997) On the pairing of the softmax activation and cross-entropy penalty functions and the derivation of the softmax activation function. In: Proceedings of 8th Australian conference on the neural networks, Melbourne, pp 181, 185

    Google Scholar 

  5. Miyamoto S, Matsuo T, Shimada N, Shirai Y (2012) Real-time and precise 3-D hand posture estimation based on classification tree trained with variations of appearances. In: Proceedings of the 21st international conference on pattern recognition (ICPR ’12), pp 453–456

    Google Scholar 

  6. Nandini MS, Hegde S, Asha Deepa A (2023) A new approach to hand gesture recognition using combined effect of CNN and HMM. Int J Emerg Technol Innov Res 10(2): 2349–5162. www.jetir.org

  7. Smith JW, Thiagarajan S, Willis R, Makris Y, Torlak M (2021) Improved static hand gesture classification on deep convolutional neural networks using novel sterile training technique. IEEE Access 9:10893–10902

    Google Scholar 

  8. Rizwan M, Haq SU, Gul N, Asif M, Shah SM (2023) Appearance based dynamic hand gesture recognition using 3d separable convolutional neural network. Comput Mater Continua 76(1):1213–1247

    Article  Google Scholar 

  9. Hussain A, Amin SU, Fayaz M, Seo S (2023) An efficient and robust hand gesture recognition system of sign language employing finetuned inception-v3 and efficientnet-b0 network. Comput Syst Sci Eng 46(3):3509–3525

    Article  Google Scholar 

  10. Sarma D, Kavyasree V, Bhuyan MK (2022) Two-stream fusion model using 3D-CNN and 2D-CNN via video-frames and optical flow motion templates for hand gesture recognition. Innova Syst Softw Eng

    Google Scholar 

  11. Gnanapriya S, Rahimunnisa K (2023) A hybrid deep learning model for real time hand gestures recognition. Intell Autom Soft Comput 36(1):1105–1119

    Google Scholar 

  12. Adhikari S, Gangopadhayay TK, Pal S, Akila D, Humayun M (2023) A novel machine learning–based hand gesture recognition using hci on iot assisted cloud platform. Comput Syst Sci Eng 46(2):2123–2140

    Google Scholar 

  13. Ur Rehman M, Ahmed F, Attique Khan M, Tariq U, Abdulaziz Alfouzan F (2022) Dynamic hand gesture recognition using 3d-cnn and lstm networks. Comput Mater Continua 70(3): 4675–4690

    Google Scholar 

  14. Zhang X, Zeng X, Sun W, Ren Y, Xu T (2023) Multimodal spatiotemporal feature map for dynamic gesture recognition. Comput Syst Sci Eng 46(1):671–686

    Article  Google Scholar 

  15. Dhall I, Vashisth S, Aggarwal G (2020) Automated hand gesture recognition using a deep convolutional neural network model. In: 10th International conference on cloud computing, data science & engineering (Confluence), pp 811–816

    Google Scholar 

  16. Luo W (2022) Research on gesture recognition based on YOLOv5. In: 3rd International conference on big data, artificial intelligence and internet of things engineering (ICBAIE), pp 447–450

    Google Scholar 

  17. Cheng J, Li Z (2021) Gesture recognition for human-computer interaction based on CNN model. In: International conference on intelligent computing, automation and applications (ICAA), pp 241–244

    Google Scholar 

  18. Munasinghe V, Li YM, Kim TS, Lee HJ (2023) CNN-based hand gesture recognition for contactless elevator button control, vol 10, pp 1–2

    Google Scholar 

  19. Khaleghi L, Artan U, Etemad A, Marshall JA (2022) Touchless control of heavy equipment using low-cost hand gesture recognition. IEEE Internet of Things Mag 5:54–57

    Google Scholar 

  20. Nitnaware S, Bagde A (2022) Hand gesture recognition to facilitate tasks for the disabled. In: Second international conference on artificial intelligence and smart energy (ICAIS), pp 949–953

    Google Scholar 

  21. Alnuaim A, Zakariah M, Hatamleh WA, Tarazi H, Tripathi V, Amoatey ET (2022) Human-computer interaction with hand gesture recognition using ResNet and MobileNet

    Google Scholar 

  22. Tharwat G, Ahmed AM, Bouallegue B (2021): Arabic sign language recognition system for alphabets using machine learning techniques. J Electr Comput Eng 17 (2021)

    Google Scholar 

  23. Alam MM, Islam MT, Rahman SMM (2022) Unified learning approach for egocentric hand gesture recognition and fingertip detection. Pattern Recogn 121:108200

    Google Scholar 

  24. Wang S, Wang A, Ran M, Liu L, Peng Y, Liu M, Su G, Alhudhaif A, Alenezi F, Alnaim N (2022) Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors. Inf Sci vol.606:722–741

    Google Scholar 

  25. Sharma S, Singh S (2020) Vision-based sign language recognition system: a comprehensive review. In: Proceedings of the international conference on inventive computation technologies (ICICT), pp 140–144

    Google Scholar 

  26. Fronteddu G, Porcu S, Floris A, Atzori L (2022) A dynamic hand gesture recognition dataset for human-computer interfaces. Comput Netw 205:108781

    Google Scholar 

  27. Doždor Z, Hrkać T, Kalafatić Z (2023) Two-model-based online hand gesture recognition from skeleton data. In: Proceedings of the 18th international joint conference on computer vision, imaging and computer graphics theory and applications, vol 4, pp 838–845

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Satya Narayan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nisha, Sonu, Narayan, S., Gajrani, J. (2025). Lightweight Deep Learning Models for Robust Hand Gesture Recognition. In: Goar, V., Kuri, M., Kumar, R., Senjyu, T. (eds) Advances in Information Communication Technology and Computing. AICTC 2024. Lecture Notes in Networks and Systems, vol 1075. Springer, Singapore. https://doi.org/10.1007/978-981-97-6106-7_48

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-6106-7_48

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-6105-0

  • Online ISBN: 978-981-97-6106-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics