Abstract
Increasing risks of spoof attacks and other common problems of unimodal biometric systems such as intra-class variations, non-universality and noisy data necessitate the use of multimodal biometrics. The face and the ear are highly attractive biometric traits for combination because of their physiological structure and location. Besides, both of them can be acquired non-intrusively. However, changes of facial expressions, variations in pose, scale and illumination and the presence of hair and ornaments present some genuine challenges. In this paper, a 3D local feature based approach is proposed to fuse ear and face biometrics at the score level. Experiments with FRGC v.2 and the University of Notre Dame Biometric databases show that the technique achieves an identification rate of 98.71% and a verification rate of 99.68% (at 0.001 FAR) for fusion of the ear with neutral face biometrics. It is also found to be fast and robust to facial expressions achieving 98.1% and 96.83% identification and verification rates respectively.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bowyer, K.W., Chang, K.I., Yan, P., Flynn, P.J., Hansley, E., Sarkar, S.: Multi-modal biometrics: an overview. In: Proc. of Second Workshop on MultiModal User Authentication (2006)
Jain, A.K., Ross, A., Pankanti, S.: Biometrics: A Tool For Information Security. IEEE Trans. on Information Forensics and Security 1, 125–143 (2006)
Ushmaev, O., Novikov, S.: Biometric Fusion: Robust Approach. In: Proc. of the Second Int’l Workshop on Multimodal User Authentication, MMUA 2006 (2006)
Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, P.: Face Recognition: A Literature Survey. ACM Computing Surveys, 399–458 (2003)
Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Computer Vision and Image Understanding 101, 1–15 (2006)
Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Computer Vision and Image Understanding 101, 1–15 (2006)
Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: Proc. of CVPR 2005, vol. 1, pp. 947–954 (2005)
Li, C., Barreto, A.: Evaluation of 3D Face Recognition in the presence of facial expressions: an Annotated Deformable Model approach. In: Proc. of ICASSP 2006, vol. 3, pp. 14–19 (2006)
Gao, Y., Maggs, M.: Feature-level fusion in personal identification. In: Proc. of CVPR 2005, vol. 1, pp. 468–473 (2005)
Ross, A., Govindarajan, R.: Feature Level Fusion Using Hand and Face Biometrics. In: Proc. of SPIE Conf. on Biometric Technology for Human Identification II, pp. 196–204 (2005)
Zhou, X., Bhanu, B.: Integrating Face and Gait for Human Recognition. In: Proc. of CVPR Workshop, pp. 55–55 (2006)
Wang, Y., Tan, T., Jain, A.K.: Combining face and iris biometrics for identity verification. In: Proc. of Int’l Conf. on Audio- and Video-based Person Authentication, pp. 805–813 (2003)
Brunelli, R., Falavigna, D.: Person identification using multiple cues. IEEE Trans. on PAMI 12, 955–966 (1995)
Islam, S., Bennamoun, M., Owens, R., Davies, R.: Biometric Approaches of 2D-3D Ear and Face: A Survey. In: Sobh, T. (ed.) Advances in Computer and Information Sciences and Engineering, pp. 509–514. Springer, Netherlands (2008)
Iannarelli, A.: Ear Identification. Forensic Identification Series. Paramount Publishing Company, Fremont, California (1989)
Yuan, L., Mu, Z., Liu, Y.: Multimodal recognition using face profile and ear. In: Proc. of the 1st Int’l Symposium on SCAA, pp. 887–891 (2006)
Xu, X.N., Mu, Z.C., Yuan, L.: Feature-level fusion method based on KFDA for multimodal recognition fusing ear and profile face. In: Proc. International Conference on ICWAPR, vol. 3, pp. 1306–1310 (2007)
Xu, X., Mu, Z.: Feature Fusion Method Based on KCCA for Ear and Profile Face Based Multimodal Recognition. In: Proc. IEEE International Conference on Automation and Logistics, pp. 620–623 (2007)
Zhou, X., Bhanu, B.: Integrating Face and Gait for Human Recognition. In: Proc. of CVPR Workshop, pp. 55–55 (2006)
Mian, A.S., Bennamoun, M., Owens, R.: 2D and 3D multimodal hybrid face recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 344–355. Springer, Heidelberg (2006)
Yan, P., Bowyer, K.W.: Multi-biometrics 2D and 3D ear recognition. In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, pp. 503–512. Springer, Heidelberg (2005)
Xu, X., Mu, Z.: Multimodal Recognition Based on Fusion of Ear and Profile Face. In: Proc. the 4th Int’l Conference on Image and Graphics, pp. 598–603 (2007)
Jain, A.K., Nandakumar, K., Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognition 38, 2270–2285 (2005)
Woodard, D., Faltemier, T., Yan, P., Flynn, P., Bowyer, K.: A comparison of 3d biometric modalities. In: Proc. of CVPR Workshop, pp. 57–61 (2006)
Mian, A.S., Bennamoun, M., Owens, R.: An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition. IEEE Trans. on PAMI 29, 1927–1943 (2007)
Islam, S., Bennamoun, M., Davies, R.: Fast and Fully Automatic Ear Detection Using Cascaded AdaBoost. In: Proc. of IEEE Workshop on Application of Computer Vision, pp. 1–6 (2008)
Mian, A., Bennamoun, M., Owens, R.: Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition. International Journal of Computer Vision 79, 1–12 (2008)
Islam, S., Davies, R., Mian, A., Bennamoun, M.: A Fast and Fully Automatic Ear Recognition Approach Based on 3D Local Surface Features. In: Blanc-Talon, J., Bourennane, S., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2008. LNCS, vol. 5259, pp. 1081–1092. Springer, Heidelberg (2008)
Islam, S., Bennamoun, M., Davies, R., Mian, A.: Fast and Fully Automatic Ear Recognition. IEEE Trans. on PAMI (under review, 2008)
Islam, S., Bennamoun, M., Mian, A., Davies, R.: A Fully Automatic Approach for Human Recognition from Profile Images Using 2D and 3D Ear Data. In: Proc. of the 4th Int’l Symposium on 3DPVT, pp. 131–141 (2008)
D’Errico, J.: (Surface fitting using gridfit) available from MATLAB Central File Exchange Select
Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Transactions on PAMI 20, 226–239 (1998)
Yan, P., Bowyer, K.W.: Biometric recognition using 3d ear shape. IEEE Trans. on PAMI 29, 1297–1308 (2007)
Chang, K., Bowyer, K.W., Sarkar, S., Victor, B.: Comparison and combination of ear and face images for appearance-based biometrics. IEEE Trans. on PAMI 25, 1160–1165 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Islam, S.M.S., Bennamoun, M., Mian, A.S., Davies, R. (2009). Score Level Fusion of Ear and Face Local 3D Features for Fast and Expression-Invariant Human Recognition. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2009. Lecture Notes in Computer Science, vol 5627. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02611-9_39
Download citation
DOI: https://doi.org/10.1007/978-3-642-02611-9_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02610-2
Online ISBN: 978-3-642-02611-9
eBook Packages: Computer ScienceComputer Science (R0)