Skip to main content
SpringerLink
Log in

Non-cooperative and Occluded Person Identification Using Periocular Region with Visible, Infra-Red, and Hyperspectral Imaging

  • Chapter
  • First Online:
Biometric Security and Privacy

Part of the book series: Signal Processing for Security Technologies ((SPST))

Abstract

The performance of automatic person identification based on visual appearance significantly suffers under occlusions in many real life situations. These occlusions may be unintentional due to the use of different items such as head gear, headphone, head scarf, or may also be caused by the style of clothing or just hair style. Intentional facial occlusions occur when a particular person try to hide his identity by hiding his face and appearance from the security cameras. In many incidents captured by surveillance videos, it has been observed that the offenders have covered their appearance and faces from the camera, leaving only the small region around the eyes known as “periocular region.” It is because the periocular region cannot be covered to maintain proper vision. In this chapter we present an extensive study on periocular region based person identification using videos in the visible spectrum, near IR range, and also by using the hyperspectral image cubes in a relatively wider bandwidth. While most of the existing techniques for periocular recognition from videos have handpicked a single best frame from videos, we formulate periocular region based person identification in video as an image-set classification problem. For thorough analysis, we perform experiments on periocular regions extracted automatically from RGB videos, NIR videos, and hyperspectral image cubes. Each image-set is represented by four heterogeneous feature types and classified with six state-of-the-art image-set classification algorithms. We will discuss in detail our novel two stage inverse Error Weighted Fusion algorithm for feature and classifier score fusion. We observe that the proposed two stage fusion is superior to single stage fusion. Comprehensive experimental results are presented on four publicly available datasets including Multiple Biometric Grand Challenge (MBGC) NIR, MBGC visible spectrum dataset both by NIST, Carnegie Mellon University (CMU) Hyperspectral face database (Tech. Report CMURI-TR-02-25), and University of Beira Interior Periocular (UBIPr) dataset. In these experiments excellent recognition on all of the four datasets has been observed. These results are significantly better than the result of most of the existing state-of-the-art methods on the same datasets and under similar experimental setup. In addition to these improvements, we demonstrate the feasibility of image-set based periocular biometrics for real world applications. Deployment of security systems with periocular region based person identification algorithm will reduce the vulnerability of security systems to be hacked by non-cooperative individuals.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. J. Adams, D. Woodard, G. Dozier, P. Miller, K. Bryant, G. Glenn, Genetic-based type ii feature extraction for periocular biometric recognition: less is more, in International Conference on Pattern Recognition, 2010 (2010), pp. 205–208

    Google Scholar 

  2. T. Ahonen, A. Hadid, M. Pietikainen, Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28 (12), 2037–2041 (2006)

    Article  MATH  Google Scholar 

  3. F. Alonso-Fernandez, J. Bigün, Periocular recognition using retinotopic sampling and gabor decomposition, in European Conference on Computer Vision, Workshops (2), 2012 (2012), pp. 309–318

    Google Scholar 

  4. F. Alonso-Fernandez, J. Bigun, A survey on periocular biometrics research. Pattern Recogn. Lett. (2015)

    Google Scholar 

  5. F. Alonso-Fernandez, J. Bigun, Near-infrared and visible-light periocular recognition with gabor features using frequency-adaptive automatic eye detection. IET Biom. 22 (4), 74–89 (2015)

    Article  Google Scholar 

  6. F. Alonso-Fernandez, J. Bigun, Periocular biometrics: databases, algorithms and directions, in International Conference on Biometrics and Forensics (IWBF) (2016), pp. 1–6

    Google Scholar 

  7. F. Alonso-Fernandez, A. Mikaelyan, J. Bigun, Comparison and fusion of multiple iris and periocular matchers using near-infrared and visible images, in Proceedings of the International Workshop Biometrics and Forensics (2015)

    Google Scholar 

  8. M. Ao, D. Yi, Z. Lei, S.Z. Li, Face recognition at a distance: system issues, in Handbook of Remote Biometrics: For Surveillance and Security (Springer, London, 2009), pp. 155–167

    Google Scholar 

  9. S. Bharadwaj, H. Bhatt, M. Vatsa, R. Singh, Periocular biometrics: when iris recognition fails, in IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2010 (2010), pp. 1–6

    Google Scholar 

  10. BIT, CASIA Iris Image Database (2013), http://biometrics.idealtest.org

  11. V. Boddeti, J. Smereka, B. Kumar, A comparative evaluation of iris and ocular recognition methods on challenging ocular images, in International Joint Conference on Biometrics, 2011 (2011), pp. 1–8

    Google Scholar 

  12. K.W. Bowyer, K. Hollingsworth, P.J. Flynn, Image understanding for iris biometrics: a survey. Comput. Vis. Image Underst. 110 (2), 281–307 (2008)

    Article  Google Scholar 

  13. Z. Cao, N. Schmid, Matching heterogeneous periocular regions: short and long standoff distances, in International Conference on Image Processing (ICIP) (2014), pp. 4967–4971

    Google Scholar 

  14. H. Cevikalp, B. Triggs, Face recognition based on image sets, in IEEE International Conference on Computer Vision and Pattern Recognition, 2010 (2010), pp. 2567–2573

    Google Scholar 

  15. Cognitec, FaceVACS-VideoScan, Face Recognition Commercial Software (2016), http://www.cognitec.com

  16. Z. Cui, H. Chang, S. Shan, B. Ma, X. Chen, Joint sparse representation for video-based face recognition. Neurocomputing 135, 306–312 (2014)

    Article  Google Scholar 

  17. L. Denes, P. Metes, Y. Liu, Hyperspectral face database. Technical Report CMU-RI-TR-02-25 (Robotics Institute, Pittsburgh, 2002)

    Google Scholar 

  18. J.X. Du, C.M. Zhai, Y.Q. Ye, Face aging simulation and recognition based on NMF algorithm with sparseness constraints. Neurocomputing 116, 250–259 (2013)

    Article  Google Scholar 

  19. J. Fierrez-aguilar, J. Ortega-garcia, D. Torre-toledano, J. Gonzalez-rodriguez, Biosec baseline corpus: a multimodal biometric database. Pattern Recogn. 40 (4), 1389–1392 (2007)

    Article  MATH  Google Scholar 

  20. K. Hollingsworth, S. Darnell, P. Miller, D. Woodard, K. Bowyer, P. Flynn, Human and machine performance on periocular biometrics under near-infrared light and visible light. IEEE Trans. Inf. Forensics Secur. 7 (2), 588–601 (2012)

    Article  Google Scholar 

  21. Y. Hu, A. Mian, R. Owens, Face recognition using sparse approximated nearest points between image sets. IEEE Trans. Pattern Anal. Mach. Intell. 34 (10), 1992–2004 (2012)

    Article  Google Scholar 

  22. J. Huang, X. You, Y. Yuan, F. Yang, L. Lin, Rotation invariant iris feature extraction using gaussian Markov random fields with non-separable wavelet. Neurocomputing 73 (4–6), 883–894 (2010)

    Article  Google Scholar 

  23. G. Inc., Pittsburgh pattern recognition. Face Recognition Commercial Software (2016), www.pittpatt.com

  24. F. Juefei-Xu, M. Savvides, Unconstrained periocular biometric acquisition and recognition using COTS PTZ camera for uncooperative and non-cooperative subjects, in IEEE Workshop on the Applications of Computer Vision, 2012 (2012), pp. 201–208

    Google Scholar 

  25. F. Juefei-Xu, K. Luu, M. Savvides, T. Bui, C. Suen, Investigating age invariant face recognition based on periocular biometrics, in International Joint Conference on Biometrics, 2011 (2011), pp. 1–7

    Google Scholar 

  26. T.K. Kim, J. Kittler, R. Cipolla, Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. Pattern Anal. Mach. Intell. 29 (6), 1005–1018 (2007)

    Article  Google Scholar 

  27. J. Kittler, M. Hatef, R.P.W. Duin, J. Matas, On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 (3), 226–239 (1998)

    Article  Google Scholar 

  28. Y. Lee, R. Micheals, P. Phillips, Improvements in video-based automated system for iris recognition, in IEEE Workshop on Motion and Video Computing (WMVC), 2009 (2009), pp. 1–8

    Google Scholar 

  29. H. Maeng, H. Choi, U. Park, S. Lee, A. Jain, Nfrad: near-infrared face recognition at a distance, in International Joint Conference on Biometrics (IJCB) (2011), pp. 1–7

    Google Scholar 

  30. G. Mahalingam, K. Ricanek, A. Albert, Investigating the periocular-based face recognition across gender transformation. IEEE Trans. Inf. Forensics Secur. 9 (12), 2180–2192 (2014)

    Article  Google Scholar 

  31. L. Masek, Recognition of human iris patterns for biometric identification. Technical Report, The University of Western Australia (2003)

    Google Scholar 

  32. G. Medioni, J. Choi, C. Kuo, A. Choudhury, L. Zhang, D. Fidaleo, Non-cooperative persons identification at a distance with 3d face modeling, in IEEE International Conference on Biometrics: Theory, Applications, and Systems (BTAS) (2007), pp. 1–6

    Google Scholar 

  33. P.E. Miller, A.W. Rawls, S.J. Pundlik, D.L. Woodard, Personal identification using periocular skin texture, in Proceedings of the ACM Symposium on Applied Computing, 2010 (2010), pp. 1496–1500

    Google Scholar 

  34. F. Moreno Seco, J. Inesta, P. Ponce de Leon, L. Mico, Comparison of classifier fusion methods for classification in pattern recognition tasks, in International Workshops on Structural and Syntactic Pattern Recognition (2006), pp. 705–713

    Google Scholar 

  35. L. Nie, A. Kumar, Periocular recognition using unsupervised convolutional rbm feature learning, in International Conference on Pattern Recognition (ICPR) (2014), pp. 299–404

    Google Scholar 

  36. NIST, Multiple Biometric Grand Challenge (MBGC) dataset (2008), http://face.nist.gov/mbgc/

    Google Scholar 

  37. NIST, Face and Ocular Challenge Series (FOCS) dataset (2010), http://www.nist.gov/itl/iad/ig/focs.cfm

  38. K. Oh, B.S. Oh, K.A. Toh, W.Y. Yau, H.L. Eng, Combining sclera and periocular features for multi-modal identity verification. Neurocomputing 128, 185–198 (2014)

    Article  Google Scholar 

  39. C. Padole, H. Proenca, Periocular recognition: analysis of performance degradation factors, in International Conference on Biometrics, 2012 (2012), pp. 439–445

    Google Scholar 

  40. U. Park, A. Ross, A. Jain, Periocular biometrics in the visible spectrum: a feasibility study, in IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2009 (2009), pp. 1–6

    Google Scholar 

  41. U. Park, R. Jillela, A. Ross, A. Jain, Periocular biometrics in the visible spectrum. IEEE Trans. Inf. Forensics Secur. 6 (1), 96–106 (2011)

    Article  Google Scholar 

  42. V.P. Pauca, M. Forkin, X. Xu, R. Plemmons, A.A. Ross, Challenging ocular image recognition, in BTHI, SPIE, vol. 8029, (2011), pp. 80291V-1–80291V-13

    Google Scholar 

  43. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, in IEEE International Conference on Computer Vision and Pattern Recognition, 2005, vol. 1 (2005), pp. 947–954

    Google Scholar 

  44. H. Proenca, S. Filipe, R. Santos, J. Oliveira, L. Alexandre, The ubiris.v2: a database of visible wavelength iris images captured on-the-move and at-a-distance. IEEE Trans. Pattern Anal. Mach. Intell. 32 (8), 1529–1535 (2010)

    Google Scholar 

  45. A. Sinha, H. Chen, D. Danu, T. Kirubarajan, M. Farooq, Estimation and decision fusion: a survey. Neurocomputing 71 (13–15), 2650–2656 (2008)

    Article  Google Scholar 

  46. Y. Song, W. Cao, Z. He, Robust iris recognition using sparse error correction model and discriminative dictionary learning. Neurocomputing 137, 198–204 (2014)

    Article  Google Scholar 

  47. C. Tan, A. Kumar, Towards online iris and periocular recognition under relaxed imaging constraints. IEEE Trans. Image Process. 22 (10), 3751–3765 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  48. M. Uzair, A. Mahmood, A. Mian, C. McDonald, Periocular biometric recognition using image sets, in IEEE Workshop on the Applications of Computer Vision, 2013 (2013), pp. 246–251

    Google Scholar 

  49. M. Uzair, A. Mahmood, A. Mian, C. McDonald, Periocular region based person identification in the visible infra-red and hyperspectral imagery. Neurocomputing 149, 854–867 (2014)

    Article  Google Scholar 

  50. P. Viola, M. Jones, Robust real-time face detection. Int. J. Comput. Vis. 57, 137–154 (2004)

    Article  Google Scholar 

  51. R. Wang, X. Chen, Manifold discriminant analysis, in IEEE International Conference on Computer Vision and Pattern Recognition, 2009 (2009), pp. 429–436

    Google Scholar 

  52. R. Wang, S. Shan, X. Chen, W. Gao, Manifold-manifold distance with application to face recognition based on image set, in IEEE International Conference on Computer Vision and Pattern Recognition, 2008 (2008), pp. 1–8

    Google Scholar 

  53. F. Wheeler, R. Weiss, P. Tu, Face recognition at a distance system for surveillance applications, in IEEE International Conference on Biometrics: Theory Applications and Systems (BTAS), (2010), pp. 1–8

    Google Scholar 

  54. D. Woodard, S. Pundlik, P. Miller, R. Jillela, A. Ross, On the fusion of periocular and iris biometrics in non-ideal imagery, in International Conference on Pattern Recognition, 2010 (2010), pp. 201–204

    Google Scholar 

  55. D. Woodard, S. Pundlik, J. Lyle, P. Miller, Periocular region appearance cues for biometric identification, in IEEE International Conference on Computer Vision and Pattern Recognition Workshops, 2010 (2010), pp. 162–169

    Google Scholar 

  56. J. Xu, M. Cha, J. Heyman, S. Venugopalan, R. Abiantun, M. Savvides, Robust local binary pattern feature sets for periocular biometric identification, in IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2010 (2010), pp. 1–8

    Google Scholar 

  57. B. Yang, S. Chen, A comparative study on local binary pattern LBP based face recognition: LBP histogram versus LBP image. Neurocomputing 120, 365–379 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work was made possible by NPRP grant number NPRP 7-1711-1-312 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, COMSATS Institute of Information Technology, Wah Cantonment, Pakistan

    Muhammad Uzair

  2. Department of Computer Science and Engineering, Qatar University, Doha, Qatar

    Arif Mahmood & Somaya Ali Al-Maadeed

Authors
  1. Muhammad Uzair
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arif Mahmood
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Somaya Ali Al-Maadeed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arif Mahmood .

Editor information

Editors and Affiliations

  1. Department of Computer and Information Science, Northumbria University, Newcastle upon Tyne, UK

    Richard Jiang

  2. Department of Computer Science and Engineering, Qatar University, Doha, Qatar

    Somaya Al-maadeed

  3. Department of Computer and Information Science, Northumbria University, Newcastle upon Tyne, UK

    Ahmed Bouridane

  4. School of Electronics, Electrical Engineering and Computer Science, ECIT Institute, Queen’s University Belfast, Belfast, Antrim, UK

    Prof. Danny Crookes

  5. Institut Galilée, Université Paris 13, Paris, France

    Azeddine Beghdadi

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Uzair, M., Mahmood, A., Ali Al-Maadeed, S. (2017). Non-cooperative and Occluded Person Identification Using Periocular Region with Visible, Infra-Red, and Hyperspectral Imaging. In: Jiang, R., Al-maadeed, S., Bouridane, A., Crookes, P.D., Beghdadi, A. (eds) Biometric Security and Privacy. Signal Processing for Security Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-47301-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-47301-7_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-47300-0

  • Online ISBN: 978-3-319-47301-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation