skip to main content
10.1145/3345336.3345338acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbeaConference Proceedingsconference-collections
research-article

Subjective Versus Objective Face Image Quality Evaluation For Face Recognition

Authors Info & Claims
Published:29 May 2019Publication History

ABSTRACT

The performance of any face recognition system gets affected by the quality of the probe and the reference images. Rejecting or recapturing images with low-quality can improve the overall performance of the biometric system. There are many statistical as well as learning-based methods that provide quality scores given an image for the task of face recognition.

In this study, we take a different approach by asking 26 participants to provide subjective quality scores that represent the ease of recognizing the face on the images from a smartphone based face image dataset. These scores are then compared to measures implemented from ISO/IEC TR 29794-5. We observe that the subjective scores outperform the implemented objective scores while having a low correlation with them. Furthermore, we analyze the effect of pose, illumination, and distance on face recognition similarity scores as well as the generated mean opinion scores.

References

  1. A. Adler and T. Dembinsky. 2006. Human Vs. Automatic Measurement of Biometric Sample Quality. In 2006 Canadian Conference on Electrical and Computer Engineering. 2090--2093.Google ScholarGoogle Scholar
  2. L. Best-Rowden and A. K. Jain. 2018. Learning Face Image Quality From Human Assessments. IEEE Transactions on Information Forensics and Security 13, 12 (Dec 2018), 3064--3077. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Samarth Bharadwaj, Mayank Vatsa, and Richa Singh. 2014. Biometric quality: a review of fingerprint, iris, and face. EURASIP Journal on Image and Video Processing 2014, 1 (02 Jul 2014), 34.Google ScholarGoogle ScholarCross RefCross Ref
  4. Jiankang Deng, Jia Guo, and Stefanos Zafeiriou. 2018. Arcface: Additive angular margin loss for deep face recognition. arXiv preprint arXiv: 1801.07698 (2018).Google ScholarGoogle Scholar
  5. W. Funk, M. Arnold, C. Busch, and A. Munde. 2005. Evaluation of image compression algorithms for fingerprint and face recognition systems. In Proceedings from the Sixth Annual IEEE SMC Information Assurance Workshop. 72--78.Google ScholarGoogle Scholar
  6. P. Grother and E. Tabassi. 2007. Performance of Biometric Quality Measures. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 4 (April 2007), 531--543. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. R. V. Hsu, J. Shah, and B. Martin. 2006. Quality Assessment of Facial Images. In 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference. 1--6.Google ScholarGoogle Scholar
  8. ISO/IEC. {n. d.}. ISO/IEC DIS 39794-5 Information technology -- Extensible biometric data interchange formats -- Part 5: Face image data. ISO/IEC.Google ScholarGoogle Scholar
  9. ISO/IEC. 2006. ISO/IEC 19795-1 Information technology -- Biometric performance testing and reporting -- Part 1: Principles and framework. ISO/IEC.Google ScholarGoogle Scholar
  10. ISO/IEC. 2010. ISO/IEC TR 29794-5 Information technology - Biometric sample quality - Part 5: Face image data. ISO/IEC.Google ScholarGoogle Scholar
  11. X. Liu, M. Pedersen, C. Charrier, and P. Bours. 2018. Can image quality enhancement methods improve the performance of biometric systems for degraded face images?. In 2018 Colour and Visual Computing Symposium (CVCS). 1--5.Google ScholarGoogle Scholar
  12. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi. 2002. A no-reference perceptual blur metric. In Proceedings. International Conference on Image Processing, Vol. 3. III-III.Google ScholarGoogle Scholar
  13. Kresimir Matkovic, László Neumann, Attila Neumann, Thomas Psik, and Werner Purgathofer. 2005. Global Contrast Factor-a New Approach to Image Contrast. Computational Aesthetics 2005 (2005), 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Ajita Rattani and Reza Derakhshani. 2018. A Survey Of mobile face biometrics. Computers & Electrical Engineering 72 (2018), 39--52.Google ScholarGoogle ScholarCross RefCross Ref
  15. Carsten Schmitz et al. 2012. LimeSurvey: An open source survey tool. LimeSurvey Project Hamburg, Germany. URL http://www.limesurvey.org (2012).Google ScholarGoogle Scholar
  16. M. V. Shirvaikar. 2004. An optimal measure for camera focus and exposure. In Thirty-Sixth Southeastern Symposium on System Theory, 2004. Proceedings of the. 472--475.Google ScholarGoogle ScholarCross RefCross Ref
  17. T. Sim, S. Baker, and M. Bsat. 2002. The CMU Pose, Illumination, and Expression (PIE) database. In Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition. 53--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. NEUROtechnology VeriLook. {n. d.}. 5.4,"VeriLook 5.4 Face SDK,".Google ScholarGoogle Scholar
  19. P. Wasnik, K. B. Raja, R. Ramachandra, and C. Busch. 2017. Assessing face image quality for smartphone based face recognition system. In 2017 5th International Workshop on Biometrics and Forensics (IWBF). 1--6.Google ScholarGoogle Scholar
  20. Pankaj Wasnik, Raghavendra Ramachandra, Kiran Raja, and Christoph Busch. 2018. An Empirical Evaluation of Deep Architectures on Generalization of Smartphone-based Face Image Quality Assessment. In IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).Google ScholarGoogle Scholar

Index Terms

  1. Subjective Versus Objective Face Image Quality Evaluation For Face Recognition

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICBEA 2019: Proceedings of the 2019 3rd International Conference on Biometric Engineering and Applications
      May 2019
      82 pages
      ISBN:9781450363051
      DOI:10.1145/3345336

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 May 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader