Abstract
Facial occlusions pose significant obstacles for robust face recognition in real-world applications. To eliminate the effect incurred by occlusions, most of the popular methods concentrate on dealing with the error between the occluded image and its recovery. Inspired by the working mechanism of human visual systems in facial occlusion detection, we suggest that it should be the error metric and clustering rather than exact recovery that play important roles for occlusion detection. By considering the structural differences between faces and occlusions, such as colors and textures, we construct five structural error metrics. By considering the common structures shared by all occlusions, such as localization and contiguity, we construct a structured clustering operator. Furthermore, we select the optimal error metric via the minimum occlusion boundary regularity criterion. Integrating the above techniques, we propose the Structural Error Metrics and Clustering (SEMC) algorithm for facial occlusion detection. Experimental results demonstrate that, even just using the mean face of the training images as the recovery image, SEMC still achieves more accurate and robust performance compared to the related state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, J., Shan, S., He, C., Zhao, G., Pietikainen, M., Chen, X., Gao, W.: Wld: a robust local image descriptor. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1705–1720 (2010)
Deng, W., Hu, J., Guo, J.: Extended src: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)
Ekenel, H.K., Stiefelhagen, R.: Why is facial occlusion a challenging problem? In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 299–308. Springer, Heidelberg (2009)
He, R., Zheng, W., Hu, B.: Maximum correntropy criterion for robust face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1561–1576 (2011)
Jia, K., Chan, T.-H., Ma, Y.: Robust and practical face recognition via structured sparsity. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 331–344. Springer, Heidelberg (2012)
Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)
Li, X.X., Dai, D.Q., Zhang, X.F., Ren, C.X.: Structured sparse error coding for face recognition with occlusion. IEEE Trans. Image Process. 22(5), 1889–1900 (2013)
Luan, X., Fang, B., Liu, L., Yang, W., Qian, J.: Extracting sparse error of robust pca for face recognition in the presence of varying illumination and occlusion. Pattern Recogn. 47(2), 495–508 (2014)
MartÃnez, A.: The ar face database. Technical report, Computer Vision Center (1998)
Tuceryan, M., Jain, A.K.: Texture analysis. Handb. Pattern Recogn. Comput. Vis. 276, 235–276 (1993)
Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: Subspace learning from image gradient orientations. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2454–2466 (2012)
Wandell, B.A.: Foundations of Vision. Sinauer Associates, Sunderland (1995)
Wright, J., Yang, A., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)
Yang, M., Zhang, L.: Gabor feature based sparse representation for face recognition with gabor occlusion dictionary. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part VI. LNCS, vol. 6316, pp. 448–461. Springer, Heidelberg (2010)
Yang, M., Zhang, L., Yang, J., Zhang, D.: Robust sparse coding for face recognition. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 625–632 (2011)
Zhou, Z., Wagner, A., Mobahi, H., Wright, J., Ma, Y.: Face recognition with contiguous occlusion using markov random fields. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1050–1057 (2009)
Acknowledgment
This work is partially supported by National Science Foundation of China (61402411, 61379017), Zhejiang Provincial Natural Science Foundation (LY14F020015, LY14F020014), and Program for New Century Excellent Talents in University of China (NCET-12–1087).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Li, XX., Liang, R., Gao, J., Wang, H. (2015). Facial Occlusion Detection via Structural Error Metrics and Clustering. In: He, X., et al. Intelligence Science and Big Data Engineering. Image and Video Data Engineering. IScIDE 2015. Lecture Notes in Computer Science(), vol 9242. Springer, Cham. https://doi.org/10.1007/978-3-319-23989-7_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-23989-7_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23987-3
Online ISBN: 978-3-319-23989-7
eBook Packages: Computer ScienceComputer Science (R0)