Skip to main content
SpringerLink
Log in

Ranking, clustering and fusing the normalized LBP temporal facial features for face recognition in video sequences

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a novel approach for recognizing faces in videos with high recognition rate. Initially, the feature vector based on Normalized Local Binary Patterns is obtained for the face region. A set of training and testing videos are used in this face recognition procedure. Each frame in the query video is matched with the signature of the faces in the database using Euclidean distance and a rank list is formed. Each ranked list is clustered and its reliability is analyzed for re-ranking. Multiple re-ranked lists of the query video is fused together to form a video signature. This video signature embeds diverse intra-personal variations such as poses, expressions and facilitates in matching two videos with large variations. For matching two videos, their composite ranked lists are compared using a Kendall Tau distance measure. The developed methods are deployed on the YouTube and ChokePoint videos, and they exhibit significant performance improvement owing to their novel approach when compared with the existing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. European Conference on Computer Vision 3021:469–448

    MATH  Google Scholar 

  2. Alex PJ, Sima D (2011) Examplers based image fusion features for face recognition. Computer Vision and Pattern Recognition, 1–13

  3. Barr JR, Bowyer KW, Flynn PJ (2012) Face recognition from video: a review. Int J Pattern Recognit Artif Intell 26(5):1–53

    Article  MathSciNet  Google Scholar 

  4. Bhatt HS, Singh R, Vatsa M (2013) On rank aggregation for face recognition from videos. In: Proceedings of International Conference on Image Processing, 1–5

  5. Borgi MA, El’Arbi M, Labate D (2015) Regularized directional feature learning for face recognition. Multimedia Tools Appl 74(24):11281–11295

    Article  Google Scholar 

  6. Chen YC, Patel VM, Phillips PJ, Chellappa R (2012) Dictionary based face recognition from video. Proceedings of European Conference on Computer Vision 7577:766–779

    Google Scholar 

  7. Chen YC, Patel VM, Shekhar S, Chellappa R, Phillips PJ (2013) Video-based face recognition via joint sparse representation. Proceedings of International Conference and Workshops on Automatic Face and Gesture Recognition, In, pp 1–8

    Book  Google Scholar 

  8. Cui Z, Shan S, Zhang H, Lao S, Chen X (2012) Image sets alignment for video-based face recognition. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, 2626–2633

  9. Cui Z, Li W, Xu D, Shan S, Chen X (2013) Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: IEEE Computer Vision and Pattern Recognition, pp 3554–3561

  10. Fumin S, Wankou Y, Hanxi L, Hanwang Z, Heng TS (2016) Robust regression based face recognition with fast outlier removal. Multimedia Tools Appl 75(20):12535–12546

    Article  Google Scholar 

  11. Hu Y, Mian AS, Owens R (2011) Sparse approximated nearest points for image set classification. IEEE Conference on computer vision and pattern recognition pp 27–40

  12. Hu C, Ye M, Zeng W (2015) An adaptive approximation image reconstruction method for single sample problem in face recognition using FLDA. Multimedia Tools Appl 74(23):10313–10334

    Article  Google Scholar 

  13. Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recogn 38(12):2270–2285

    Article  Google Scholar 

  14. Jiang X, Yu H, Lu Y (2016) A fusion method for robust face tracking. Multimedia Tools Appl 75(19):11801–11813

    Article  Google Scholar 

  15. Jin Y, Cao J, Wang Y (2016) Ensemble based extreme learning machine for cross-modality face matching. Multimedia Tools Appl 75(19):11831–11846

    Article  Google Scholar 

  16. Kim M, Kumar S, Pavlovic V, Rowley H (2008a) Face tracking and recognition with visual constraints in real-world videos. In: Proceed of International conference on computer vision and pattern recognition, pp 1–8

  17. Kim M, Kumar S, Pavlovic V, Rowley H (2008b) Face Tracking and recognition with visual constraints in real-world videos. In: Proceed of international conference on computer vision and pattern recognition, pp 1–8

  18. Liu X, Chen T (2003) Video-based face recognition using adaptive Hidden Markov Models. In: Proceedings of international conference on computer vision and pattern recognition, pp 340–345

  19. O’ Toole AJ, Roark DA, Abdi H (2002) Recognizing moving faces: a psychological and neural synthesis. Trends Cogn Sci 6(6):261–266

    Article  Google Scholar 

  20. Pengfei Z, Wangmeng Z, Lei Z, Simon C, David Z (2014) Image set-based collaborative representation for face recognition. IEEE Trans Inf Forensics Secur 9(7):1120–1132

    Article  Google Scholar 

  21. Sculley D (2007) Rank aggregation for similar items. In: Proceedings of the international conference on data mining, pp 587–592

  22. Sun Y, Jia H, Hu Y (2014) Color face recognition based on color image correlation similarity discriminant model. Multimedia Tools Appl 73(3):2063–2079

    Article  Google Scholar 

  23. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: proceedings of IEEE Computer society conference on computer vision and pattern recognition, pp 511–518

  24. Wang R, Shan S, Chen X, Dai Q, Gao W (2012) Manifold-manifold distance and its application to face recognition with image sets. IEEE Trans Image Process 21(10):4466–4479

    Article  MathSciNet  MATH  Google Scholar 

  25. Wolf L, Hassner T, Maoz I (2011) Face recognition in unconstrained videos with matched background similarity. International conference on computer vision and pattern recognition, pp 529–534

  26. Wong Y, Chen S, Mau S, Sanderson C, Lovell BC (2011) Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. IEEE Biometrics workshop, computer vision and pattern recognition workshops, pp 81–88

  27. Yun T, Guan L (2009) Automatic face detection in video sequences using local normalization and optimal adaptive correlation techniques. Pattern Recogn 42(9):1859–1868

    Article  MATH  Google Scholar 

  28. Zhang J, Gao J, Zhou M, Wang J (2001) Improving the effectiveness of information retrieval with clustering and fusion. J Comput Linguist Chin Lang Process 6(1):109–125

    Google Scholar 

  29. Zhou S, Krueger V, Chellappa R (2003) Probabilistic recognition of human faces from video. Comp Vis Image Underst 91(1–2):214–245

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Mepco Schlenk Engineering College, Mepco Nagar, Amathur Post, Sivakasi, 626 005, India

    P. Ithaya Rani

  2. Department of Electrical & Electronics Engineering, Kalasalingam University, Anand Nagar, Krishnankoil, 626126, India

    T. Hari Prasath

Authors
  1. P. Ithaya Rani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. T. Hari Prasath
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. Ithaya Rani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ithaya Rani, P., Hari Prasath, T. Ranking, clustering and fusing the normalized LBP temporal facial features for face recognition in video sequences. Multimed Tools Appl 77, 5785–5802 (2018). https://doi.org/10.1007/s11042-017-4491-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4491-6

Keywords

Search

Navigation