Abstract
In this paper, we propose a novel multimedia sensor fusion approach based on heterogeneous sensors for biometric access control applications. The proposed fusion technique uses multiple acoustic and visual sensors for extracting dominant biometric cues, and combines them with non-dominant cues. The performance evaluation of the proposed fusion protocol and a novel cascaded authentication approach using a 3D stereovision database shows a significant improvement in performance and robustness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Potamianos, G.G., Neti, C., Gravier, G., Garg, A., Senior, A.W.: Recent Advances in the Automatic Recognition of Audiovisual Speech. Proceedings of the IEEE 91, 1306–1324 (2003)
Chelubishi, C.C., Deravi, F., Mason, J.S.D.: A Review of Speech-Based Bimodal Recognition. IEEE Transactions on Multimedia 4, 23–35 (2002)
Brunellil, R., Falavigna, D.: Person Identification Using Multiple Cues. IEEE Transactions on Pattern Analysis and Machine Intelligence 17, 955–966 (1995)
Santi, A., Servos, P., Vatikiotis-Bateson, E., Kuratate, T., Munhall, K.: Perceiving biological motion: Dissociating talking from walking. Journal of Cognitive Neuroscience 15, 800–809 (2003)
Callan, D., Jones, J.A., Munhall, K.G., Kroos, C., Callan, A., Vatikiotis-Bateson, E.: Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport 14, 2213–2218 (2003)
Hani, C.Y., Kuratate, T., Vatikiotis-Bateson, E.: Linking facial animation, head motion, and speech acoustics. Journal of Phonetics 30(3), 555–568 (2002)
Kroos, C., Kuratate, T., Vatikiotis-Bateson, E.: Video-based face motion measurement. Journal of Phonetics 30(3), 569–590 (2002)
Goecke, R., Millar, J.B.: The Audio-Video Australian English Speech Data Corpus AVOZES. In: Proceedings of the 8th International Conference on Spoken Language Processing INTERSPEECH 2004 - ICSLP, vol. III, pp. 2525–2528 (2004)
Chetty, G., Wagner, M.: Automated lip feature extraction for liveness verification in audio-video authentication. In: Proc. Image and Vision Computing, New Zealand, pp. 17–22 (2004)
Chetty, G., Wagner, M.: Audio-Visual Speaker Identity Verification using Lip Motion Features. In: Proc. INTERSPEECH 2007 Conference (2007)
Hyvarinen, A., Oja, E.: Independent Component Analysis: Algorithms and Applications. Neural Networks 13(4-5), 411–430 (2000)
Dutagaci, H., Sankur, B., Yemez, Y.: 3D face recognition by projection-based features. In: Proc. SPIE Conf. on Electronic Imaging: Security, Steganography, and Watermarking of Multimedia (2006)
Gokberk, B., Irfanoglu, M.O., Akarun, L.: 3D shape-based face representation and facial feature extraction for face recognition (in press). Image and Vision Computing (2006)
Kahraman, F., Stegmann, M.B.: Towards Illumination-invariant Localization of Faces using Active Appearance Models. In: IEEE NORSIG 2006 (2006)
Quatieri, T.F.: Discrete Time Speech Signal Processing. Signal Processing Series. Prentice Hall, Englewood Cliffs (2002)
H.264/MPEG-4 AVC standard, (retreived on 15/5/2009) http://www.itu.int/ITU-T/worksem/vica/docs/presentations/S3_P1_Sullivan.pdf
Bower, K.W., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multimodal 3D + 2D face recognition. Computer Vision and Image Understanding 101(1), 1–15 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chetty, G., Biswas, R., Goodwin, J. (2010). Identity Retrieval in Biometric Access Control Systems Using Multimedia Fusion. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds) Neural Information Processing. Models and Applications. ICONIP 2010. Lecture Notes in Computer Science, vol 6444. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17534-3_73
Download citation
DOI: https://doi.org/10.1007/978-3-642-17534-3_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17533-6
Online ISBN: 978-3-642-17534-3
eBook Packages: Computer ScienceComputer Science (R0)