Abstract
It has been observed that many face recognition algorithms fail to recognize faces after plastic surgery, which thus poses a new challenge to automatic face recognition. This paper first gives a comprehensive study on Face Recognition After Plastic Surgery (FRAPS), with careful analysis of the effects of plastic surgery on face appearance and its challenges to face recognition. Then, to address FRAPS problem, an ensemble of Gabor Patch classifiers via Rank-Order list Fusion (GPROF) is proposed, inspired by the assumption of the interior consistency of face components in terms of identity. On the face database of plastic surgery, GPROF achieves much higher face identification rate than the best known results in the literature. Furthermore, with our impressive results, we suggest that plastic surgery detection should be paid more attend to. To address this problem, a partial matching based plastic surgery detection algorithm is proposed, aiming to detect four distinct types of surgery, i.e., the eyelid surgery, nose surgery, forehead surgery and face lift surgery. Our experimental results demonstrate that plastic surgery detection is a nontrivial task, and thus deserves more research efforts.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Asian Plastic Surgery Guide: Cosmetic plastic surgery in south korea (2012), http://www.asianplasticsurgeryguide.com/korea/a_korean.html
American Society for Aesthetic Plastic Surgery: 2011 ASAPS statistics: Complete charts [including national totals, percent of change, gender distribution, age distribution, national average fees, economic, regional and ethnic information] (2012), http://www.surgery.org/media/statistics
Singh, R., Vatsa, M., Bhatt, H., Bharadwaj, S., Noore, A., Nooreyezdan, S.: Plastic surgery: a new dimension to face recognition. IEEE Transactions on Information Forensics and Security 5, 441–448 (2010)
Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 711–720 (1997)
Penev, P., Atick, J.: Local feature analysis: A general statistical theory for object representation. Network: Computation in Neural Systems 7, 477–500 (1996)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 2037–2041 (2006)
Dreuw, P., Steingrube, P., Hanselmann, H., Ney, H.: Surf-face: Face recognition under viewpoint consistency constraints. In: British Machine Vision Conference, vol. 2, p. 7 (2009)
Singh, R., Vatsa, M., Noore, A.: Face recognition with disguise and single gallery images. Image and Vision Computing 27, 245–257 (2009)
Bhatt, H., Bharadwaj, S., Singh, R., Vatsa, M., Noore, A.: Evolutionary granular approach for recognizing faces altered due to plastic surgery. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 720–725. IEEE (2011)
Aggarwal, G., Biswas, S., Flynn, P., Bowyer, K.: A sparse representation approach to face matching across plastic surgery. In: IEEE Workshop on Applications of Computer Vision (2012)
De Marsico, M., Nappi, M., Riccio, D., Wechsler, H.: Robust Face Recognition after Plastic Surgery Using Local Region Analysis. In: Kamel, M., Campilho, A. (eds.) ICIAR 2011, Part II. LNCS, vol. 6754, pp. 191–200. Springer, Heidelberg (2011)
Lakshmiprabha, N., Bhattacharya, J., Majumder, S.: Face recognition using multimodal biometric features. In: 2011 International Conference on Image Information Processing (ICIIP), pp. 1–6. IEEE (2011)
Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Transactions on Image Processing 11, 467–476 (2002)
Serrano, Á., de Diego, I.M., Conde, C., Cabello, E.: Recent advances in face biometrics with gabor wavelets: A review. Pattern Recognition Letters 31, 372–381 (2010)
Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proceedings of the IEEE Computer Society Conference on CVPR 1991, pp. 586–591. IEEE (1991)
Zhu, C., Wen, F., Sun, J.: A rank-order distance based clustering algorithm for face tagging. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 481–488. IEEE (2011)
Schroff, F., Treibitz, T., Kriegman, D., Belongie, S.: Pose, illumination and expression invariant pairwise face-similarity measure via doppelgänger list comparison. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2494–2501. IEEE (2011)
Xie, X., Lam, K.: An efficient illumination normalization method for face recognition. Pattern Recognition Letters 27, 609–617 (2006)
Phillips, P., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 947–954. IEEE (2005)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 971–987 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, X., Shan, S., Chen, X. (2013). Face Recognition after Plastic Surgery: A Comprehensive Study. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7725. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37444-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-37444-9_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37443-2
Online ISBN: 978-3-642-37444-9
eBook Packages: Computer ScienceComputer Science (R0)