Abstract
In this paper, a dual-layer block-based metric learning technique is proposed to better discriminate the face image pairs and accelerate the overall verification process under the unconstrained environment. The input images are processed as blocks to provide a richer base of face features. Our proposed method is formed by two layers, in which the first layer assists in extracting the compact block-based descriptors without the existence of full class label information and to refine the within-class and between-class scatter matrices while the second layer integrates the face descriptors of all blocks. The proposed scheme has computational advantage over the single metric learning method while it exploits the correlations among the multiple metrics from different descriptors. The performance of our proposed method is evaluated on the Labeled Faces in the Wild database and achieves an improved performance when compared with the state-of-the-art methods in terms of verification rate and computation time.
Similar content being viewed by others
References
Ahonen T, Pietikäinen M (2007) Soft histograms for local binary patterns, in proc. Finnish Signal Processing Symposium (FINSIG)
Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Machine Intell 28(12):2037–2041
Anila S, Devarajan N (2012) Preprocessing Technique for Face Recognition Applications Under Varying Illumination Conditions. Global Journal of Computer Science and Technology
Barkan O, Weill J, Wolf L, Aronowitz H (2013) Fast high dimensional vector multiplication face recognition, computer vision (ICCV), 2013 I.E. International Conference on, pp. 1960–1967, 1–8
Cao Q, Ying Y, Li P (2013) Similarity metric learning for face recognition. International Conference on Computer Vision (ICCV)
Censor Y, Zenios S (1998) Parallel optimization: theory, algorithms and applications. Oxford University Press, USA
Chang C-C, Lin C-J (2001) LIBSVM: A Library for Support Vector Machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. IEEE Conf Comput Vision Pattern Recogn (CVPR)
Davis J, Kulis B, Jain P, Sra S, Dhilon I (2007) Information-theoretic metric learning. ICML
Chen D, Cao X, Wen F, Sun J (2013) Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. Comput Vision Pattern Recogn (CVPR)
Efron B, Hastie T, Johnstone I, Tibshirani R (2004) Least angle regression. Ann Stat 32(2):407–499
Etemad K, Chellappa R (1997) Discriminant analysis for recognition of human face images. J Opt Soc Am 14:1724–1733
Fan H, Cao Z, Jiang Y, Yin Q, Doudou C (2014) Learning deep face representation. Technical report, Megvii. Inc, Beijing
Guillaumin M, Verbeek J, Schmid C (2009) Is that you? Metric learning approaches for face identification. International Conference on Computer Vision (ICCV)
Hu J, Lu J, Tan Y-P (2014) Discriminative Deep Metric Learning for Face Verification in the Wild. IEEE Conference on Computer Vision and Pattern Recognition
Huang GB, Ramesh M, Berg T, Learned-Miller E (2007a) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. University ofMassachusetts, Amherst, Technical Report 07-49
Huang D, Wang Y, Wang Y (2007b) A robust method for near infrared face recognition based on extended local binary pattern, in Proc. Int. Symposium on Visual Computing (ISVC) 437–446
Huang C, Zhu S, Yu K (2011a) Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval. NEC Technical Report TR115
Huang D, Shan C, Ardabilian M, Wang Y, Chen L (2011b) Local binary patterns and its application to facial image analysis: a survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Hussain S, Napolean T, Jurie F (2012) Face recognition using local quantized patterns. British machine vision conference
Jin H, Liu Q, Lu H, Tong X (2004) Face detection using improved LBP under Bayesian Framework, in Proc Int. Conf. Image and Graphics (ICIG) 306–309
Kan M, Shan S, Xu D, Chen X (2011) Side-information based linear discriminant analysis for face recognition. British Machine Vision Conference (BMVC), UK
Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification. International Conference on Computer Vision (ICCV)
Li Z, Imai J, Kaneko M (2010) Robust face recognition using block-based bag of words. International Conference on Pattern Recognition
Nguyen HV (2011) Linear Subspace Methods in Face Recognition (Ph.D. thesis), University of Nottingham
Nguyen HV, Bai L (2010) Cosine similarity metric learning for face verification. Asian Conference on Computer Vision (ACCV)
Pollard DE (2002) A user’s guide to measure theoretic probability. Cambridge University Press
Simonyan K, Parkhi OM, Vedaldi A, Zisserman A (2013) Fisher vector faces in the wild. In British Machine Vision Conference
Sun Y, Wang X, Tang X (2013) Hybrid deep learning for face verification. IEEE International Conference on Computer Vision (ICCV)
Sun Y, Wang X, Tang X (2014a) Deep learning face representation from predicting 10,000 classes. IEEE Conference on Computer Vision and Pattern Recognition
Sun Y, Wang X, Tang X (2014b) Deep learning face representation by joint identification-verification, in neural information processing systems (NIPS)
Taigman Y, Yang M, Ranzato MA, Wolf L (2014) DeepFace: closing the gap to human-level performance in face verification. IEEE Conference on Computer Vision and Pattern Recognition
Turk M, Pentland A (1991) Eigenfaces for Recognition. J Cogn Neurosci 3(1):71–86
Welling M (2005) Fisher Linear Discriminant Analysis. http://www.ics.uci.edu/~welling/classnotes/papers_class/Fisher-LDA.pdf
Wolf L, Hassner T, Taigman Y (2008) Descriptor based methods in the wild. European Conference on Computer Vision
Wolf L, Hassner T, Taigman Y (2009) Similarity Scores based on Background Samples. Asian Conference on Computer Vision (ACCV)
Wolf L, Hassner T, Taigman Y (2011) Effective unconstrained face recognition by combining multiple descriptors and learned background statistics. IEEE Transactions On Pattern Analysis and Machine Intelligence
Yang H, Wang Y (2007) A LBP-based face recognition method with hamming distance constraint, in Proc. Int. Conf. Image and Graphics (ICIG) 645–649
Acknowledgments
This research is supported by Fundamental Research Grant Scheme (FRGS) of Malaysia under grants MMUE/140026.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chong, SC., Teoh, A.B.J. & Ong, TS. Unconstrained face verification with a dual-layer block-based metric learning. Multimed Tools Appl 76, 1703–1719 (2017). https://doi.org/10.1007/s11042-015-3120-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-3120-5