Abstract
Recently, the wide deployment of practical face recognition systems gives rise to the emergence of the inter-modality face recognition problem. In this problem, the face images in the database and the query images captured on spot are acquired under quite different conditions or even using different equipments. Conventional approaches either treat the samples in a uniform model or introduce an intermediate conversion stage, both of which would lead to severe performance degradation due to the great discrepancies between different modalities. In this paper, we propose a novel algorithm called Common Discriminant Feature Extraction specially tailored to the inter-modality problem. In the algorithm, two transforms are simultaneously learned to transform the samples in both modalities respectively to the common feature space. We formulate the learning objective by incorporating both the empirical discriminative power and the local smoothness of the feature transformation. By explicitly controlling the model complexity through the smoothness constraint, we can effectively reduce the risk of overfitting and enhance the generalization capability. Furthermore, to cope with the nongaussian distribution and diverse variations in the sample space, we develop two nonlinear extensions of the algorithm: one is based on kernelization, while the other is a multi-mode framework. These extensions substantially improve the recognition performance in complex situation. Extensive experiments are conducted to test our algorithms in two application scenarios: optical image-infrared image recognition and photo-sketch recognition. Our algorithms show excellent performance in the experiments.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. on PAMI 19(7), 711–720 (1997)
Zhao, W., Chellappa, R., Krishnaswamy, A.: Discriminant Analysis of Principal Components for Face Recognition. In: Proc. of FGR (1998)
Yang, J., Frangi, F., Yang, J., Zhang, D., Jin, Z.: KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition. IEEE Trans. on PAMI 27(2), 230–244 (2005)
Liu, C., Wechsler, H.: Enhanced Fisher Linear Discriminant Models for Face Recognition. In: Proc. of CVPR 1998 (1998)
Wang, X., Tang, X.: A Unified Framework for Subspace Face Recognition. IEEE Trans. on PAMI 26(9), 1222–1228 (2004)
Wang, X., Tang, X.: Unified Subspace Analysis for Face Recognition. In: Proc. of ICCV 2003 (2003)
Wang, X., Tang, X.: Dual-Space Linear Discriminant Analysis for Face Recognition. In: Proc. of CVPR 2004 (2004)
Tang, X., Wang, X.: Face Sketch Synthesis and Recognition. In: Proc. of ICCV 2003 (2003)
Tang, X., Wang, X.: Face Sketch Recognition. IEEE Trans. CSVT 14(1), 50–57 (2004)
Vapnik, V.N.: Statistical Learning Theory. John Wiley and Sons, Chichester (1998)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with Local and Global Consistency. In: Proc. of NIPS 2004 (2004)
He, X., Yan, S., Hu, Y., Zhang, H.: Learning a Locality Preserving Subspace for Visual Recognition. In: Proc. of ICCV 2003 (2003)
He, X., Hu, Y., Niyogi, P., Zhang, H.: Face Recognition Using Laplacianfaces. IEEE Trans. PAMI 27(3), 328–340 (2005)
Belkin, M., Niyogi, P.: Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. In: Proc. of NIPS 2001 (2001)
Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET Evaluation Methodology for Face Recognition Algorithms. IEEE Trans. PAMI, 1090–1104 (2000)
Tang, X., Wang, X.: Face Sketch Recognition. IEEE Trans. CSVT 14(1), 50–57 (2004)
Turk, M., Pentland, A.: Eigenfaces for Recognition. J. Cogn. Neuro. 3(1), 71–86 (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, D., Tang, X. (2006). Inter-modality Face Recognition. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3954. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744085_2
Download citation
DOI: https://doi.org/10.1007/11744085_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33838-3
Online ISBN: 978-3-540-33839-0
eBook Packages: Computer ScienceComputer Science (R0)