[go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Video indexing through human face images using LGFA and window technique

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Adaptive video monitoring settings have been extensively deployed in recent years. Smart video monitoring technology enables the acquisition and analysis of movies from various devices, as well as automatic analysis based on knowledge gathering. However, the storage capacity is restricted, and the important frames from the movie cannot be saved. Though, if the movie employs face as keyframes, it creates space and time complexity. To address this issue, the Viola-Jones Algorithm was used to detect faces from extracted keyframes in Video Indexing through Human Face Images using LGFA and the sliding window technique. The image gradient for brightness is created by integrating the sliding windowing method with LGFA, and scanning the input image horizontally takes up 70% of the facial image. As a result, Barcode as an index using the sequence table of the EAN 8 approach converts a video’s human face into an EAN-8 linear video indexing barcode and thereby reducing bandwidth, storage space, and time complexity. Regular TV series video datasets, datasets of YouTube faces, and data sets of Hollywood clips were used to evaluate the proposed technique, and shown to be effective for indexing videos based on human faces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Adeyemo J, Oyebode O, Stretch D (2018) River flow forecasting using an improved artificial neural network. EVOLVE-A Bridge Between Probability, Set Oriented Numerics, and Evolutionary Computation VI. Springer, Cham 179–193

  2. Anayat S, Sikandar A, Rasheed SA, Butt S (2020) A deep analysis of image based video searching techniques. Int J Wirel Microw Technol (IJWMT) 10(4):39–48

    Google Scholar 

  3. Bahroun S, Abed R, Zagrouba E (2020) KS-FQA: Keyframe selection based on face quality assessment for efficient face recognition in video. IET Image Process 15:77–90

    Article  Google Scholar 

  4. Bastanfard A, Takahashi H, Nakajima M (2004) Toward E-appearance of human face and hair by age, expression and rejuvenation. International conference on Cyberworlds. IEEE

  5. Bastanfard A, Bastanfard O, Takahashi H, Nakajima M (2004) Toward anthropometrics simulation of face rejuvenation and skin cosmetic. Computer Animation and Virtual Worlds 15(3–4):347–352

    Article  Google Scholar 

  6. Deng Y, Yu Y (2019) Self-feedback image retrieval algorithm based on annular color moments. EURASIP Journal on Image and Video Processing 2019(1):1–13

    Article  Google Scholar 

  7. Dong Z, Wei J, Chen X, Zheng P (2020) Face detection in security monitoring based on artificial intelligence video retrieval technology. IEEE Access 8:63421–63433

    Article  Google Scholar 

  8. Dutta G (2021) Create caption by extracting features from image and video using deep learning model

  9. Feng Y, Zhou P, Xu J, Ji S, Wu D (2018) Video big data retrieval over media cloud: a context-aware online learning approach. IEEE Transactions on Multimedia 21(7):1762–1777

    Article  Google Scholar 

  10. Gawande U, Hajari K, Golhar Y (2020) Deep learning approach to key frame detection in human action videos. Recent Trends in Computational Intelligence. IntechOpen

  11. Gayathri N, Mahesh K (2020) Improved fuzzy-based SVM classification system using feature extraction for video indexing and retrieval. International Journal of Fuzzy Systems 22:1716–1729

    Article  Google Scholar 

  12. Ghatak S, Bhattacharjee D (2020) Video indexing through human face, present the paper in third international conference on communications, circuits and systems held at school of electronics engineering. Kalinga Institute of Industrial Technology, Bhubaneswar, Video Indexing Through Human Face.

  13. Hoy MB (2018) Deep learning and online video: advances in transcription, automated indexing, and manipulation. Medical reference services quarterly 37(3):300–305

    Article  Google Scholar 

  14. Jacob J, Sudheep Elayidom M, Devassia VP (2020) Video content analysis and retrieval system using video storytelling and indexing techniques. International Journal of Electrical & Computer Engineering 10(6):6019

    Google Scholar 

  15. Ji LY, Yang Z (2017) Design and implementation of medication recommending system for chronic hepatitis B. Chinese Medical Equipment Journal 38(7):48–51

    Google Scholar 

  16. Kratochvíl, Miroslav, et al. (2020) Som-hunter: video browsing with relevance-to-som feedback loop. International conference on multimedia modeling. Springer, Cham, SOM-Hunter: Video Browsing with Relevance-to-SOM Feedback Loop

  17. Krishnaraj N, Elhoseny M, Lydia EL, Shankar K, and Aldabbas O (2020) An efficient radix trie-based semantic visual indexing model for large-scale image retrieval in cloud environment. Software: Practice and Experience

  18. Kumar GN, Reddy VSK (2019) Key frame extraction using rough set theory for video retrieval. In Soft Computing and Signal Processing:751–757

  19. Li C, Zhou B (2020) Fast key-frame image retrieval of intelligent city security video based on deep feature coding in high concurrent network environment. Journal of ambient intelligence and humanized computing 1-9.

  20. Li D, Liao X, Xiang T, Wu J, Le J (2020) Privacy-preserving self-serviced medical diagnosis scheme based on secure multi-party computation. Computers & Security 90:101701

    Article  Google Scholar 

  21. Lin FC, Ngo HH, Dow CR (2020) A cloud-based face video retrieval system with deep learning. J Supercomput 76(11):8473–8493

    Article  Google Scholar 

  22. Rossetto L, Gasser R, Lokoc J, Bailer W, Schoeffmann K, Muenzer B, Soucek T, Nguyen PA, Bolettieri P, Leibetseder A, Vrochidis S (2020) Interactive video retrieval in the age of deep learning-detailed evaluation of vbs 2019. IEEE Transactions on Multimedia 23:243–256

    Article  Google Scholar 

  23. Rossetto L et al. (2021) Interactive video retrieval in the age of deep learning – detailed evaluation of VBS 2019. In IEEE transactions on multimedia 23: 243-256

  24. Saritha RR, Paul V, Kumar PG (2019) Content based image retrieval using deep learning process. Clust Comput 22(2):4187–4200

    Article  Google Scholar 

  25. Sauter L et al. (2020) Combining boolean and multimedia retrieval in vitrivr for large-scale video search. International conference on multimedia modeling. Springer, Cham, Combining Boolean and Multimedia Retrieval in vitrivr for Large-Scale Video Search

  26. Tian H, Tao Y, Pouyanfar S, Chen SC, Shyu ML (2019) Multimodal deep representation learning for video classification. World Wide Web 22(3):1325–1341

    Article  Google Scholar 

  27. Ullah A, Muhammad K, Hussain T, Baik SW, De Albuquerque VHC (2020) Event-oriented 3d convolutional features selection and hash codes generation using pca for video retrieval. IEEE Access 8:196529–196540

    Article  Google Scholar 

  28. Yan C, Gong B, Wei Y, Gao Y (2020) Deep multi-view enhancement hashing for image retrieval. IEEE Trans Pattern Anal Mach Intell 43:1445–1451

    Article  Google Scholar 

  29. Yürekli A, Bilge A, Kaleli C (2021) Exploring playlist titles for cold-start music recommendation: an effectiveness analysis. Journal of Ambient Intelligence and Humanized Computing 1–20

  30. Zhang C, Lin Y, Zhu L, Liu A, Zhang Z, Huang F (2019) CNN-VWII: an efficient approach for large-scale video retrieval by image queries. Pattern Recogn Lett 123:82–88

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sikkim Manipal Institute of Technology, Staff Quater L-304, Majitar, Rangpo, East Sikkim, India

    Sanjoy Ghatak

  2. Jadavpur University, 188, Raja S.C. Mallick Rd, Kolkata, West Bengal, 700032, India

    Debotosh Battacharjee

Authors
  1. Sanjoy Ghatak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debotosh Battacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanjoy Ghatak.

Ethics declarations

Conflict of interest

None.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghatak, S., Battacharjee, D. Video indexing through human face images using LGFA and window technique. Multimed Tools Appl 81, 31509–31527 (2022). https://doi.org/10.1007/s11042-022-12965-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12965-2

Keywords