skip to main content
article

Face recognition: A literature survey

Published:01 December 2003Publication History
Skip Abstract Section

Abstract

As one of the most successful applications of image analysis and understanding, face recognition has recently received significant attention, especially during the past several years. At least two reasons account for this trend: the first is the wide range of commercial and law enforcement applications, and the second is the availability of feasible technologies after 30 years of research. Even though current machine recognition systems have reached a certain level of maturity, their success is limited by the conditions imposed by many real applications. For example, recognition of face images acquired in an outdoor environment with changes in illumination and/or pose remains a largely unsolved problem. In other words, current systems are still far away from the capability of the human perception system.This paper provides an up-to-date critical survey of still- and video-based face recognition research. There are two underlying motivations for us to write this survey paper: the first is to provide an up-to-date review of the existing literature, and the second is to offer some insights into the studies of machine recognition of faces. To provide a comprehensive survey, we not only categorize existing recognition techniques but also present detailed descriptions of representative methods within each category. In addition, relevant topics such as psychophysical studies, system evaluation, and issues of illumination and pose variation are covered.

References

  1. Adini, Y., Moses, Y., and Ullman, S. 1997. Face recognition: The problem of compensating for changes in illumination direction. IEEE Trans. Patt. Anal. Mach. Intell. 19, 721--732.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Akamatsu, S., Sasaki, T., Fukamachi, H., Masui, N., and Suenaga, Y. 1992. An accurate and robust face identification scheme. In Proceedings, International Conference on Pattern Recognition. 217--220.]]Google ScholarGoogle Scholar
  3. Atick, J., Griffin, P., and Redlich, N. 1996. Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computat. 8, 1321--1340.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Azarbayejani, A., Starner, T., Horowitz, B., and Pentland, A. 1993. Visually controlled graphics. IEEE Trans. Patt. Anal. Mach. Intell. 15, 602--604.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bachmann, T. 1991. Identification of spatially quantized tachistoscopic images of faces: How many pixels does it take to carry identity? European J. Cog. Psych. 3, 87--103.]]Google ScholarGoogle ScholarCross RefCross Ref
  6. Bailly-Bailliere, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Mariethoz, J., Matas, J., Messer, K., Popovici, V., Poree, F., Ruiz, B., and Thiran, J. P. 2003. The BANCA database and evaluation protocol. In Proceedings of the International Conference on Audio- and Video-Based Biometric Person Authentication. 625--638.]]Google ScholarGoogle Scholar
  7. Bartlett, J. C. and Searcy, J. 1993. Inversion and configuration of faces. Cog. Psych. 25, 281--316.]]Google ScholarGoogle ScholarCross RefCross Ref
  8. Bartlett, M. S., Lades, H. M., and Sejnowski, T. 1998. Independent component representation for face recognition. In Proceedings, SPIE Symposium on Electronic Imaging: Science and Technology. 528--539.]]Google ScholarGoogle Scholar
  9. Basri, R. and Jacobs, D. W. 2001. Lambertian refelectances and linear subspaces. In Proceedings, International Conference on Computer Vision. Vol. II. 383--390.]]Google ScholarGoogle Scholar
  10. Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J. 1997. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Patt. Anal. Mach. Intell. 19, 711--720.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Belhumeur, P. N. and Kriegman, D. J. 1997. What is the set of images of an object under all possible lighting conditions? In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 52--58.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bell, A. J. and Sejnowski, T. J. 1995. An information maximisation approach to blind separation and blind deconvolution. Neural Computation 7, 1129--1159.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Bell, A. J. and Sejnowski, T. J. 1997. The independent components of natural scenes are edge filters. Vis. Res. 37, 3327--3338.]]Google ScholarGoogle ScholarCross RefCross Ref
  14. Beveridge, J. R., She, K., Draper, B. A., and Givens, G. H. 2001. A nonparametric statisical comparison of principal component and linear discriminant subspaces for face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. (An updated version can be found online at http://www.cs.colostate.edu/evalfacerec/news.html.)]]Google ScholarGoogle Scholar
  15. Beymer, D. 1995. Vectorizing face images by interleaving shape and texture computations. MIT AI Lab memo 1537. Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Beymer, D. J. 1993. Face recognition under varying pose. Tech. Rep. 1461. MIT AI Lab, Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Beymer, D. J. and Poggio, T. 1995. Face recognition from one example view. In Proceedings, International Conference on Computer Vision. 500--507.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Biederman, I. 1987. Recognition by components: A theory of human image understanding. Psych. Rev. 94, 115--147.]]Google ScholarGoogle ScholarCross RefCross Ref
  19. Biederman, I. and Kalocsai, P. 1998. Neural and psychophysical analysis of object and face recognition. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 3--25.]]Google ScholarGoogle Scholar
  20. Bigun, J., Duc, B., Smeraldi, F., Fischer, S., and Makarov, A. 1998. Multi-modal person authentication. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 26--50.]]Google ScholarGoogle Scholar
  21. Black, M., Fleet, D., and Yacoob, Y. 1998. A Framework for modelling appearance change in image sequences. In Proceedings, International Conference on Computer Vision, 660--667.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Black, M. and Yacoob, Y. 1995. Tracking and recognizing facial expressions in image sequences using local parametrized models of image motion. Tech. rep. CS-TR-3401. Center for Automation Research, Unversity of Maryland, College Park, MD.]]Google ScholarGoogle Scholar
  23. Blackburn, D., Bone, M., and Phillips, P. J. 2001. Face recognition vendor test 2000. Tech. rep. http://www.frvt.org.]]Google ScholarGoogle Scholar
  24. Blanz, V. and Vetter, T. 1999. A Morphable model for the synthesis of 3D faces. In Proceedings, SIGGRAPH'99, 187--194.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Blanz, V. and Vetter, T. 2003. Face recognition based on fitting a 3D morphable model. IEEE Trans. Patt. Anal. Mach. Intell. 25, 1063--1074.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Bledsoe, W. W. 1964. The model method in facial recognition. Tech. rep. PRI:15, Panoramic research Inc., Palo Alto, CA.]]Google ScholarGoogle Scholar
  27. Brand, M. and Bhotika, R. 2001. Flexible flow for 3D nonrigid tracking and shape recovery. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  28. Brennan, S. E. 1985. The caricature generator. Leonardo, 18, 170--178.]]Google ScholarGoogle ScholarCross RefCross Ref
  29. Bronstein, A., Bronstein, M., Gordon, E., and Kimmel, R. 2003. 3D face recognition using geometric invariants. In Proceedings, International Conference on Audio- and Video-Based Person Authentication.]]Google ScholarGoogle Scholar
  30. Bruce, V. 1988. Recognizing faces, Lawrence Erlbaum Associates, London, U.K.]]Google ScholarGoogle Scholar
  31. Bruce, V., Burton, M., and Dench, N. 1994. What's distinctive about a distinctive face? Quart. J. Exp. Psych. 47A, 119--141.]]Google ScholarGoogle ScholarCross RefCross Ref
  32. Bruce, V., Hancock, P. J. B., and Burton, A. M. 1998. Human face perception and identification. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 51--72.]]Google ScholarGoogle Scholar
  33. Bruner, I. S. and Tagiuri, R. 1954. The perception of people. In Handbook of Social Psychology, Vol. 2, G. Lindzey, Ed., Addison-Wesley, Reading, MA, 634--654.]]Google ScholarGoogle Scholar
  34. Buhmann, J., Lades, M., and Malsburg, C. v. d. 1990. Size and distortion invariant object recognition by hierarchical graph matching. In Proceedings, International Joint Conference on Neural Networks. 411--416.]]Google ScholarGoogle Scholar
  35. Chellappa, R., Wilson, C. L., and Sirohey, S. 1995. Human and machine recognition of faces: A survey. Proc. IEEE, 83, 705--740.]]Google ScholarGoogle ScholarCross RefCross Ref
  36. Choudhury, T., Clarkson, B., Jebara, T., and Pentland, A. 1999. Multimodal person recognition using unconstrained audio and video. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 176--181.]]Google ScholarGoogle Scholar
  37. Cootes, T., Taylor, C., Cooper, D., and Graham, J. 1995. Active shape models---their training and application. Comput. Vis. Image Understand. 61, 18--23.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Cootes, T., Walker, K., and Taylor, C. 2000. View-based active appearance models. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Cootes, T. F., Edwards, G. J., and Taylor, C. J. 2001. Active appearance models. IEEE Trans. Patt. Anal. Mach. Intell. 23, 681--685.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Cox, I. J., Ghosn, J., and Yianilos, P. N. 1996. Feature-based face recognition using mixture-distance. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 209--216.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Craw, I. and Cameron, P. 1996. Face recognition by computer. In Proceedings, British Machine Vision Conference. 489--507.]]Google ScholarGoogle Scholar
  42. Darwin, C. 1972. The Expression of the Emotions in Man and Animals. John Murray, London, U.K.]]Google ScholarGoogle Scholar
  43. DeCarlo, D. and Metaxas, D. 2000. Optical flow constraints on deformable models with applications to face tracking. Int. J. Comput. Vis. 38, 99--127.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., and Sejnowski, T. J. 1999. Classifying facial actions. IEEE Trans. Patt. Anal. Mach. Intell. 21, 974--989.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Edwards, G. J., Taylor, C. J., and Cootes, T. F. 1998. Learning to identify and track faces in image sequences. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Ekman, P. Ed., 1998. Charles Darwin's The Expression of the Emotions in Man and Animals, Third Edition, with Introduction, Afterwords and Commentaries by Paul Ekman. HarperCollins/Oxford University Press, New York, NY/London, U.K.]]Google ScholarGoogle Scholar
  47. Ellis, H. D. 1986. Introduction to aspects of face processing: Ten questions in need of answers. In Aspects of Face Processing, H. Ellis, M. Jeeves, F. Newcombe, and A. Young, Eds. Nijhoff, Dordrecht, The Netherlands, 3--13.]]Google ScholarGoogle Scholar
  48. Etemad, K. and Chellappa, R. 1997. Discriminant analysis for recognition of human face images. J. Opt. Soc. Am. A 14, 1724--1733.]]Google ScholarGoogle ScholarCross RefCross Ref
  49. Fisher, R. A. 1938. The statistical utilization of multiple measuremeents. Ann. Eugen. 8, 376--386.]]Google ScholarGoogle ScholarCross RefCross Ref
  50. Freeman, W. T. and Tenenbaum, J. B. 2000. Separating style and contents with bilinear models. Neural Computat. 12, 1247--1283.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Fukunaga, K. 1989. Statistical Pattern Recognition, Academic Press, New York, NY.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Galton, F. 1888. Personal identification and description. Nature, (June 21), 173--188.]]Google ScholarGoogle Scholar
  53. Gauthier, I., Behrmann, M., and Tarr, M. J. 1999. Can face recognition really be dissociated from object recognition? J. Cogn. Neurosci. 11, 349--370.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Gauthier, I. and Logothetis, N. K. 2000. Is face recognition so unique after All? J. Cogn. Neuropsych. 17, 125--142.]]Google ScholarGoogle ScholarCross RefCross Ref
  55. Georghiades, A. S., Belhumeur, P. N., and Kriegman, D. J. 1999. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In Proceedings, Workshop on Multi-View Modeling and Analysis of Visual Scenes, 47--54.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Georghiades, A. S., Belhumeur, P. N., and Kriegman, D. J. 2001. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Patt. Anal. Mach. Intell. 23, 643--660.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Georghiades, A. S., Kriegman, D. J., and Belhumeur, P. N. 1998. Illumination cones for recognition under variable lighting: Faces. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 52--58.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Ginsburg, A. G. 1978. Visual information processing based on spatial filters constrained by biological data. AMRL Tech. rep. 78--129.]]Google ScholarGoogle Scholar
  59. Gong, S., McKenna, S., and Psarrou, A. 2000. Dynamic Vision: From Images to Face Recognition. World Scientific, Singapore.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Gordon, G. 1991. Face recognition based on depth maps and surface curvature. In SPIE Proceedings, Vol. 1570: Geometric Methods in Computer Vision. SPIE Press, Bellingham, WA 234--247.]]Google ScholarGoogle Scholar
  61. Gu, L., Li, S. Z., and Zhang, H. J. 2001. Learning probabilistic distribution model for multiview face dectection. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  62. Hager, G. D., and Belhumeur, P. N. 1998. Efficient region tracking with parametri models of geometry and illumination. IEEE Trans. Patt. Anal. Mach. Intell. 20, 1--15.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Hallinan, P. W. 1991. Recognizing human eyes. In SPIE Proceedings, Vol. 1570: Geometric Methods In Computer Vision. 214--226.]]Google ScholarGoogle Scholar
  64. Hallinan, P. W. 1994. A low-dimensional representation of human faces for arbitrary lighting conditions. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 995--999.]]Google ScholarGoogle ScholarCross RefCross Ref
  65. Hancock, P., Bruce, V., and Burton, M. 1998. A comparison of two computer-based face recognition systems with human perceptions of faces. Vis. Res. 38, 2277--2288.]]Google ScholarGoogle ScholarCross RefCross Ref
  66. Harmon, L. D. 1973. The recognition of faces. Sci. Am. 229, 71--82.]]Google ScholarGoogle Scholar
  67. Heisele, B., Serre, T., Pontil, M., and Poggio, T. 2001. Component-based face detection. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  68. Hill, H. and Bruce, V. 1996. Effects of lighting on matching facial surfaces. J. Exp. Psych.: Human Percept. Perform. 22, 986--1004.]]Google ScholarGoogle ScholarCross RefCross Ref
  69. Hill, H., Schyns, P. G., and Akamatsu, S. 1997. Information and viewpoint dependence in face recognition. Cognition 62, 201--222.]]Google ScholarGoogle ScholarCross RefCross Ref
  70. Hjelmas, E. and Low, B. K. 2001. Face detection: A Survey. Comput. Vis. Image Understand. 83, 236--274.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Horn, B. K. P. and Brooks, M. J. 1989. Shape from Shading. MIT Press, Cambridge, MA.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Huang, J., Heisele, B., and Blanz, V. 2003. Component-based face recognition with 3D morphable models. In Proceedings, International Conference on Audio- and Video-Based Person Authentication.]]Google ScholarGoogle Scholar
  73. Isard, M. and Blake, A. 1996. Contour tracking by stochastic propagation of conditional density. In Proceedings, European Conference on Computer Vision.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Jacobs, D. W., Belhumeur, P. N., and Basri, R. 1998. Comparing images under variable illumination. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 610--617.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Jebara, T., Russel, K., and Pentland, A. 1998. Mixture of eigenfeatures for real-time structure from texture. Tech. rep. TR-440, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA.]]Google ScholarGoogle Scholar
  76. Johnston, A., Hill, H., and Carman, N. 1992. Recognizing faces: Effects of lighting direction, inversion and brightness reversal. Cognition 40, 1--19.]]Google ScholarGoogle Scholar
  77. Kalocsai, P. K., Zhao, W., and Elagin, E. 1998. Face similarity space as perceived by humans and artificial systems. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 177--180.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Kanade, T. 1973. Computer recognition of human faces. Birkhauser, Basel, Switzerland, and Stuttgart, Germany.]]Google ScholarGoogle Scholar
  79. Kelly, M. D. 1970. Visual identification of people by computer. Tech. rep. AI-130, Stanford AI Project, Stanford, CA.]]Google ScholarGoogle Scholar
  80. Kirby, M. and Sirovich, L. 1990. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. Patt. Anal. Mach. Intell. 12.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Klasen, L. and Li, H. 1998. Faceless identification. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 513--527.]]Google ScholarGoogle Scholar
  82. Knight, B. and Johnston, A. 1997. The role of movement in face recognition. Vis. Cog. 4, 265--274.]]Google ScholarGoogle ScholarCross RefCross Ref
  83. Kruger, N., Potzsch, M., and Malsburg, C. v. d. 1997. Determination of face position and pose with a learned representation based on labelled graphs. Image Vis. Comput. 15, 665--673.]]Google ScholarGoogle ScholarCross RefCross Ref
  84. Kung, S. Y. and Taur, J. S. 1995. Decision-based neural networks with signal/image classification applications. IEEE Trans. Neural Netw. 6, 170--181.]]Google ScholarGoogle ScholarCross RefCross Ref
  85. Lades, M., Vorbruggen, J., Buhmann, J., Lange, J., Malsburg, C. v.d., Wurtz, R., and Konen, W. 1993. Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42, 300--311.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Lanitis, A., Taylor, C. J., and Cootes, T. F. 1995. Automatic face identification system using flexible appearance models. Image Vis. Comput. 13, 393--401.]]Google ScholarGoogle ScholarCross RefCross Ref
  87. Lawrence, S., Giles, C. L., Tsoi, A. C., and Back, A. D. 1997. Face recognition: A convolutional neural-network approach. IEEE Trans. Neural Netw. 8, 98--113.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Li, B. and Chellappa, R. 2001. Face verification through tracking facial features. J. Opt. Soc. Am. 18.]]Google ScholarGoogle ScholarCross RefCross Ref
  89. Li, S. Z. and Lu, J. 1999. Face recognition using the nearest feature line method. IEEE Trans. Neural Netw. 10, 439--443.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. Li, Y., Gong, S., and Liddell, H. 2001a. Constructing facial identity surfaces in a nonlinear discriminating space. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  91. Li, Y., Gong, S., and Liddell, H. 2001b. Modelling face dynamics across view and over time. In Proceedings, International Conference on Computer Vision.]]Google ScholarGoogle Scholar
  92. Lin, S. H., Kung, S. Y., and Lin, L. J. 1997. Face recognition/detection by probabilistic decision-based neural network. IEEE Trans. Neural Netw. 8, 114--132.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. Liu, C. and Wechsler, H. 2000a. Evolutionary pursuit and its application to face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 22, 570--582.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Liu, C. and Wechsler, H. 2000b. Robust coding scheme for indexing and retrieval from large face databases. IEEE Trans. Image Process. 9, 132--137.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  95. Liu, C. and Wechsler, H. 2001. A shape- and texture-based enhanced fisher classifier for face recognition. IEEE Trans. Image Process. 10, 598--608.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Liu, J. and Chen, R. 1998. Sequential Monte Carlo methods for dynamic systems. J. Am. Stat. Assoc. 93, 1031--1041.]]Google ScholarGoogle ScholarCross RefCross Ref
  97. Manjunath, B. S., Chellappa, R., and Malsburg, C. v. d. 1992. A feature based approach to face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 373--378.]]Google ScholarGoogle Scholar
  98. Marr, D. 1982. Vision. W. H. Freeman, San Francisco, CA.]]Google ScholarGoogle Scholar
  99. Martinez, A. 2002. Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class. IEEE Trans. Patt. Anal. Mach. Intell. 24, 748--763.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. Martinez, A. and Kak, A. C. 2001. PCA versus LDA. IEEE Trans. Patt. Anal. Mach. Intell. 23, 228--233.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Maurer, T. and Malsburg, C. v. d. 1996a. Single-view based recognition of faces rotated in depth. In Proceedings, International Workshop on Automatic Face and Gesture Recognition. 176--181.]]Google ScholarGoogle Scholar
  102. Maurer, T. and Malsburg, C. v. d. 1996b. Tracking and learning graphs and pose on image sequences of faces. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 176--181.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. McKenna, S. J. and Gong, S. 1997. Non-intrusive person authentication for access control by visual tracking and face recognition. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 177--183.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. McKenna, S. and Gong, S. 1998. Recognising moving faces. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 578--588.]]Google ScholarGoogle Scholar
  105. Matas, J. et. al., 2000. Comparison of face verification results on the XM2VTS database. In Proceedings, International Conference on Pattern Recognition, Vol. 4, 858--863.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Messer, K., Matas, J., Kittler, J., Luettin, J., and Maitre, G. 1999. XM2VTSDB: The Extended M2VTS Database. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 72--77.]]Google ScholarGoogle Scholar
  107. Mika, S., Ratsch, G., Weston, J., Scholkopf, B., and Muller, K.-R. 1999. Fisher discriminant analysis with kernels. In Proceedings, IEEE Workshop on Neural Networks for Signal Processing.]]Google ScholarGoogle Scholar
  108. Moghaddam, B., Nastar, C., and Pentland, A. 1996. A Bayesian similarity measure for direct image matching. In Proceedings, International Conference on Pattern Recognition.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. Moghaddam, B. and Pentland, A. 1997. Probabilistic visual learning for object representation. IEEE Trans. Patt. Anal. Mach. Intell. 19, 696--710.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  110. Moon, H. and Phillips, P. J. 2001. Computational and performance aspects of PCA-based face recognition algorithms. Perception, 30, 301--321.]]Google ScholarGoogle ScholarCross RefCross Ref
  111. Murase, H. and Nayar, S. 1995. Visual learning and recognition of 3D objects from appearances. Int. J. Comput. Vis. 14, 5--25.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Nefian, A. V. and Hayes III, M. H. 1998. Hidden Markov models for face recognition. In Proceedings, International Conference on Acoustics, Speech and Signal Processing. 2721--2724.]]Google ScholarGoogle Scholar
  113. Okada, K., Steffans, J., Maurer, T., Hong, H., Elagin, E., Neven, H., and Malsburg, C. v. d. 1998. The Bochum/USC Face Recognition System and how it fared in the FERET Phase III Test. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 186--205.]]Google ScholarGoogle Scholar
  114. O'Toole, A. J., Roark, D., and Abdi, H. 2002. Recognitizing moving faces. A psychological and neural synthesis. Trends Cogn. Sci. 6, 261--266.]]Google ScholarGoogle ScholarCross RefCross Ref
  115. Pantic, M. and Rothkrantz, L. J. M. 2000. Automatic analysis of facial expressions: The state of the art. IEEE Trans. Patt. Anal. Mach. Intell. 22, 1424--1446.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  116. Penev, P. and Sirovich, L. 2000. The global dimensionality of face space. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  117. Penev, P. and Atick, J. 1996. Local feature analysis: A general statistical theory for objecct representation. Netw.: Computat. Neural Syst. 7, 477--500.]]Google ScholarGoogle ScholarCross RefCross Ref
  118. Pentland, A., Moghaddam, B., and Starner, T. 1994. View-based and modular eigenspaces for face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  119. Perkins, D. 1975. A definition of caricature and recognition. Stud. Anthro. Vis. Commun. 2, 1--24.]]Google ScholarGoogle ScholarCross RefCross Ref
  120. Phillips, P. J., Grother, P. J., Micheals, R. J., Blackburn, D. M., Tabassi, E., and Bone, J. M. 2003. Face recognition vendor test 2002: Evaluation report. NISTIR 6965, 2003. Available online at http://www.frvt.org.]]Google ScholarGoogle Scholar
  121. Phillips, P. J. 1998. Support vector machines applied to face fecognition. Adv. Neural Inform. Process. Syst. 11, 803--809.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  122. Phillips, P. J., McCabe, R. M., and Chellappa, R. 1998. Biometric image processing and recognition. In Proceedings, European Signal Processing Conference.]]Google ScholarGoogle Scholar
  123. Phillips, P. J., Moon, H., Rizvi, S., and Rauss, P. 2000. The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 22.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  124. Phillips, P. J., Wechsler, H., Huang, J., and Rauss, P. 1998b. The FERET database and evaluation procedure for face-recognition algorithms. Image Vis. Comput. 16, 295--306.]]Google ScholarGoogle ScholarCross RefCross Ref
  125. Pigeon, S. and Vandendorpe, L. 1999. The M2VTS multimodal face database (Release 1.00). In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 403--409.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  126. Riklin-Raviv, T. and Shashua, A. 1999. The quotient image: Class based re-rendering and recognition with varying illuminations. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 566--571.]]Google ScholarGoogle Scholar
  127. Rizvi, S. A., Phillips, P. J., and Moon, H. 1998. A verification protocol and statistical performance analysis for face recognition algorithms. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 833--838.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. Rowley, H. A., Baluja, S., and Kanade, T. 1998. Neural network based face detection. IEEE Trans. Patt. Anal. Mach. Intell. 20.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  129. Choudhury, A. K. R. and Chellappa, R. 2003. Face reconstruction from monocular video using uncertainty analysis and a generic model. Comput. Vis. Image Understand. 91, 188--213.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  130. Ruderman, D. L. 1994. The statistics of natural images. Netw.: Comput. Neural Syst. 5, 598--605.]]Google ScholarGoogle ScholarCross RefCross Ref
  131. Sali, E. and Ullman, S. 1998. Recognizing novel 3-D objects under new illumination and viewing position using a small number of example views or even a single view. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 153--161.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  132. Samal, A. and Iyengar, P. 1992. Automatic recognition and analysis of human faces and facial expressions: A survey. Patt. Recog. 25, 65--77.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  133. Samaria, F. 1994. Face recognition using hidden markov models. Ph.D. dissertation. University of Cambridge, Cambridge, U.K.]]Google ScholarGoogle Scholar
  134. Samaria, F. and Young, S. 1994. HMM based architecture for face identification. Image Vis. Comput. 12, 537--583.]]Google ScholarGoogle ScholarCross RefCross Ref
  135. Schneiderman, H. and Kanade, T. 2000. Probabilistic modelling of local Appearance and spatial reationships for object recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 746--751.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  136. Sergent, J. 1986. Microgenesis of face perception. In Aspects of Face Processing, H. D. Ellis, M. A. Jeeves, F. Newcombe, and A. Young, Eds. Nijhoff, Dordrecht, The Netherlands.]]Google ScholarGoogle Scholar
  137. Shashua, A. 1994. Geometry and photometry in 3D visual recognition. Ph.D. dissertation. Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  138. Shepherd, J. W., Davies, G. M., and Ellis, H. D. 1981. Studies of cue saliency. In Perceiving and Remembering Faces, G. M. Davies, H. D. Ellis, and J. W. Shepherd, Eds. Academic Press, London, U.K.]]Google ScholarGoogle Scholar
  139. Shio, A. and Sklansky, J. 1991. Segmentation of people in motion. In Proceedings, IEEE Workshop on Visual Motion. 325--332.]]Google ScholarGoogle Scholar
  140. Sirovich, L. and Kirby, M. 1987. Low-dimensional procedure for the characterization of human face. J. Opt. Soc. Am. 4, 519--524.]]Google ScholarGoogle ScholarCross RefCross Ref
  141. Steffens, J., Elagin, E., and Neven, H. 1998. PersonSpotter---fast and robust system for human detection, tracking and recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 516--521.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  142. Strom, J., Jebara, T., Basu, S., and Pentland, A. 1999. Real time tracking and modeling of faces: An EKF-based analysis by synthesis approach. Tech. rep. TR-506, MIT Media Lab, Massachusetts, Institute of Technology, Cambridge, MA.]]Google ScholarGoogle Scholar
  143. Sung, K. and Poggio, T. 1997. Example-based learning for view-based human face detection. IEEE Trans. Patt. Anal. Mach. Intell. 20, 39--51.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  144. Swets, D. L. and Weng, J. 1996b. Using discriminant eigenfeatures for image retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 18, 831--836.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  145. Swets, D. L. and Weng, J. 1996. Discriminant analysis and eigenspace partition tree for face and object recognition from views. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 192--197.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  146. Tarr, M. J. and Bulthoff, H. H. 1995. Is human object recognition better described by geon structural descriptions or by multiple views---comment on Biederman and Gerhardstein (1993). J. Exp. Psych.: Hum. Percep. Perf. 21, 71--86.]]Google ScholarGoogle ScholarCross RefCross Ref
  147. Terzopoulos, D. and Waters, K. 1993. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Patt. Anal. Mach. Intell. 15, 569--579.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  148. Thompson, P. 1980. Margaret Thatcher---A new illusion. Perception, 9, 483--484.]]Google ScholarGoogle ScholarCross RefCross Ref
  149. Tsai, P. S. and Shah, M. 1994. Shape from shading using linear approximation. Image Vis. Comput. 12, 487--498.]]Google ScholarGoogle ScholarCross RefCross Ref
  150. Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. 2000. Bundle adjustment---a modern synthesis. In Vision Algorithms: Theory and Practice, Springer-Verlag, Berlin, Germany.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  151. Turk, M. and Pentland, A. 1991. Eigenfaces for recognition. J. Cogn. Neurosci. 3, 72--86.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  152. Ullman, S. and Basri, R. 1991. Recognition by linear combinations of models. IEEE Trans. Patt. Anal. Mach. Intell. 13, 992--1006.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  153. Vapnik, V. N. 1995. The Nature of Statistical Learning Theory. Springer-Verlag, New York, NY.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  154. Vetter, T. and Poggio, T. 1997. Linear object classes and image synthesis from a single example image. IEEE Trans. Patt. Anal. Mach. Intell. 19, 733--742.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  155. Viola, P. and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google ScholarGoogle Scholar
  156. Wechsler, H., Kakkad, V., Huang, J., Gutta, S., and Chen, V. 1997. Automatic video-based person authentication using the RBF network. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 85--92.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  157. Wilder, J. 1994. Face recognition using transform coding of gray scale projection and the neural tree network. In Artificial Neural Networks with Applications in Speech and Vision, R. J. Mammone, Ed. Chapman Hall, New York, NY, 520--536.]]Google ScholarGoogle Scholar
  158. Wiskott, L., Fellous, J.-M., and von der Malsburg, C. 1997. Face recognition by elastic bunch graph matching. IEEE Trans. Patt. Anal. Mach. Intell. 19, 775--779.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  159. Yang, M. H., Kriegman, D., and Ahuja, N. 2002. Detecting faces in images: A survey. IEEE Trans. Patt. Anal. Mach. Intell. 24, 34--58.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  160. Yin, R. K. 1969. Looking at upside-down faces. J. Exp, Psych. 81, 141--151.]]Google ScholarGoogle ScholarCross RefCross Ref
  161. Yuille, A. L., Cohen, D. S., and Hallinan, P. W. 1992. Feature extractiong from faces using deformable templates. Int. J. Comput. Vis. 8, 99--112.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  162. Yuille, A. and Hallinan, P. 1992. Deformable templates. In Active vision, A. Blake, and A. Yuille, Eds., Cambridge, MA, 21--38.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  163. Zhao, W. 1999. Robust Image Based 3D Face Recognition, Ph.D. dissertation. University of Maryland, College Park, MD.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  164. Zhao, W. and Chellappa, R. 2000b. SFS Based View synthesis for robust face recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  165. Zhao, W. and Chellappa, R. 2000. Illumination-insensitive face recognition using symmetric shape-from-shading. In Proceedings, Conference on Computer Vision and Pattern Recognition. 286--293.]]Google ScholarGoogle Scholar
  166. Zhao, W., Chellappa, R., and Krishnaswamy, A. 1998. Discriminant analysis of principal components for face recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 336--341.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  167. Zhao, W., Chellappa, R., and Phillips, P. J. 1999. Subspace linear discriminant analysis for face recognition. Tech. rep. CAR-TR-914, Center for Automation Research, University of Maryland, College Park, MD.]]Google ScholarGoogle Scholar
  168. Zhou, S., Krueger, V., and Chellappa, R. 2003. Probabilistic recognition of human faces from video. Comput. Vis. Image Understand. 91, 214--245.]] Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Face recognition: A literature survey

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Computing Surveys
      ACM Computing Surveys  Volume 35, Issue 4
      December 2003
      129 pages
      ISSN:0360-0300
      EISSN:1557-7341
      DOI:10.1145/954339
      Issue’s Table of Contents

      Copyright © 2003 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 December 2003
      Published in csur Volume 35, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader