Abstract
The main challenge in recognizing faces in video is effectively exploiting the multiple frames of a face and the accompanying dynamic signature. One prominent method is based on extracting joint appearance and behavioral features. A second method models a person by temporal correlations of features in a video. Our approach introduces the concept of video-dictionaries for face recognition, which generalizes the work in sparse representation and dictionaries for faces in still images. Video-dictionaries are designed to implicitly encode temporal, pose, and illumination information. We demonstrate our method on the Face and Ocular Challenge Series (FOCS) Video Challenge, which consists of unconstrained video sequences. We show that our method is efficient and performs significantly better than many competitive video-based face recognition algorithms.
Chapter PDF
Similar content being viewed by others
Keywords
- Receiver Operating Characteristic Curve
- Face Recognition
- Video Sequence
- Face Image
- False Acceptance Rate
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Zhao, W., Chellappa, R., Phillips, J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys, 399–458 (December 2003)
Phillips, P.J.: Matching pursuit filters applied to face identification. IEEE Transactions on Image Processing 7(8), 1150–1164 (1998)
Patel, V.M., Wu, T., Biswas, S., Philips, P.J., Chellappa, R.: Dictionary-based face recognition under variable lighting and pose. IEEE Transactions on Information Forensics and Security 7(3), 954–965 (2012)
Tistarelli, M., Li, S.Z., Chellappa, R.: Handbook of Remote Biometrics: For Surveillance and Security. Springer (2009)
Ross, A., Nandakumar, K., Jain, A.K.: Handbook of Multibiometrics. Springer (2006)
Zhou, S., Krueger, V., Chellappa, R.: Probabilistic recognition of human faces from video. Computer Vision and Image Understanding, Special Issue on Face Recognition 91, 214–245 (2003)
Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99, 303–331 (2005)
Hager, G., Belhumeur, P.: Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(10), 1025–1039 (1998)
Lanitis, A., Taylor, C., Cootes, T.: Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 743–756 (1997)
Zhou, S.K., Chellappa, R., Moghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Transactions on Image Processing 13(11), 1491–1506 (2004)
La Cascia, M., Sclaroff, S., Athitsos, V.: Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(4), 322–336 (2000)
Aggarwal, G., Veeraraghavan, A., Chellappa, R.: 3D facial pose tracking in uncalibrated videos. In: International Conference on Pattern Recognition and Machine Intelligence (2005)
Arandjelović, O., Cipolla, R.: Face Recognition from Video Using the Generic Shape-Illumination Manifold. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part IV. LNCS, vol. 3954, pp. 27–40. Springer, Heidelberg (2006)
Turaga, P.K., Veeraraghavan, A., Srivastava, A., Chellappa, R.: Statistical computations on grassmann and stiefel manifolds for image and video-based recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(11), 2273–2286 (2011)
Hu, Y., Mian, A.S., Owens, R.: Sparse approximated nearest points for image set classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 27–40 (2011)
Shroff, N., Turaga, P., Chellappa, R.: Video précis: Highlighting diverse aspects of videos. IEEE Transactions on Multimedia 12(8), 853–868 (2010)
Aharon, M., Elad, M., Bruckstein, A.: K-svd: An algorithm for desigining overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing (November 2006)
Phillips, P.J., Flynn, P.J., Beveridge, J.R., Scruggs, W.T., O’Toole, A.J., Bolme, D., Bowyer, K.W., Draper, B.A., Givens, G.H., Lui, Y.M., Sahibzada, H., Scallan III, J.A., Weimer, S.: Overview of the Multiple Biometrics Grand Challenge. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 705–714. Springer, Heidelberg (2009)
Information Technology Laboratory, National Institute of Standards and Technology: Multiple biomertic grand challenge, http://www.nist.gov/itl/iad/ig/mbgc.cfm
O’Toole, A.J., Harms, J., Snow, S.L., Hurst, D.R., Pappas, M.R., Ayyad, J.H., Abdi, H.: Recognizing people from dynamic and static faces and bodies: Dissecting identity with a fusion approach. Vision Research 51(1), 74–83 (2005)
Information Technology Laboratory, National Institute of Standards and Technology: Face and ocular challenge series, http://www.nist.gov/itl/iad/ig/focs.cfm
Turaga, P.K., Veeraraghavan, A., Chellappa, R.: Statistical analysis on stiefel and grassmann manifolds with applications in computer vision. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
O’Toole, A.J., Phillips, P.J., Weimer, S., Roark, D.A., Ayyad, J., Barwick, R., Dunlop, J.: Recognizing people from dynamic and static faces and bodies: Dissecting identity with a fusion approach. Vision Research 51(1), 74–83 (2011)
Wang, R., Chen, X.: Manifold dsicriminant analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 429–436 (2009)
Kim, M.K., Arandjelovic, O., Cipolla, R.: Discrimitive learning and recognition of image set classes using canonical correlations. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 1005–1018 (2007)
Wang, R., Shan, S., Chen, X., Gao, W.: Manifold-manifold distance with application to face recognition based on image set. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Cevikalp, H., Triggs, B.: Face recognition based on image sets. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2567–2573 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, YC., Patel, V.M., Phillips, P.J., Chellappa, R. (2012). Dictionary-Based Face Recognition from Video. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33783-3_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-33783-3_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33782-6
Online ISBN: 978-3-642-33783-3
eBook Packages: Computer ScienceComputer Science (R0)