Abstract
Signature recognition is identifying the signature’s owner, whereas verification is the process to find whether a signature is genuine or forged. Though, both are important in the field of forensic sciences, however, verification is more important to banks and credit card companies. In this paper, we have proposed a methodology to analyze 3D signatures captured using Leap motion sensor. We have extended existing 2D features into 3D from raw signatures and applied well-known classifiers for recognition as well as verification. We have shown that the 3rd dimension, which essentially represents instantaneous pressure during writing, can improve the accuracy of the biometric systems. We have created a large dataset containing more than 2000 signatures registered by 100 volunteers using the Leap motion interface. This has been made available online for the research community. Our analysis shows that, the proposed 3D extension is better than its original 2D version. Recognition and verification accuracy have increased by 6.8% and 9.5%, respectively using k-NN. Similarly, accuracy has increased by 9.9% (recognition) and 6.5% (verification) when HMM is used as the classifier. Similar results have been recorded on benchmark datasets. A comparison with 2D tablet-stylus interface has been carried out which also supports our claims. We believe, Leap motion can be an alternative to the existing biometric setups.
Similar content being viewed by others
References
Alister K, Yanikoglu B (2005) Identity authentication using improved on-line signature verification method. Pattern Recogn Lett 26(18):2400–2408
Bailador G, Sanchez-Avila C, Guerra-Casanova J, Santos Sierra de A (2011) Analysis of pattern recognition techniques for in-air signature biometrics. Pattern Recogn 44(10):2468–2478
Bashir M, Scharfenberg G, Kempfürgen J (2011) Person authentication by handwriting in air using a biometric smart pen device. BIOSIG 12:219–226
Byeon W, Liwicki M, Breuel TM (2014) Texture classification using 2d lstm networks. In: 2014 22nd international conference on pattern recognition, pp 1144–1149
Chahar A, Yadav S, Nigam I, Singh R, Vatsa M (2015) A leap password based verification system. In: 7th international conference on biometrics theory, applications and systems, pp 1–6
Chuan C, Regina E, Guardino C (2014) American sign language recognition using leap motion sensor. In: Proceedings of the 13th international conference on machine learning and applications, pp 541– 544
Dolfing J, Aarts E, van Oosterhout J (1998) On-line signature verification with hidden markov models. In: Proceedings of the 14th international conference on pattern recognition, 1998, vol 2, pp 1309–1312
Draouhard J, Sabourin R, Godbout M (1996) A neural network approaches to on-line signature verification using directional pdf. Pattern Recogn 29:415–424
Elons A, Ahmed M, Shedid H, Tolba M (2014) Arabic sign language recognition using leap motion sensor. In: Proceedings of the 9th international conference on computer engineering & systems. IEEE, pp 368–373
Fang B, Leung C, Tang Y, Tse K, Kwokd P, Wonge Y (2003) Off-line signature verification by the tracking of feature and stroke positions. Pattern Recogn 36(1):91–101
Faundez-Zanuy M (2007) On-line signature recognition based on vq-dtw. Pattern Recogn 40(3):981–992
Fernandez F, Fierrez J, Diaz M, Garcia J (2009) Fusion of static image and dynamic information for signature verification. In: Proceedings of the IEEE international conference on image processing, pp 2725–2728
Ferrer M, Alonso J, Travieso C (2005) Off-line geometric parameters for automatic signature verification using fixed-point arithmetic. IEEE Trans Pattern Anal Mach Intell 993–997
Guru D, Prakash H (2009) Online signature verification and recognition: an approach based on symbolic representation. IEEE Trans Pattern Anal Mach Intell 31 (6):1059–1073
Houmani N, Garcia-Salicetti S (2014) Digitizing tablet. In: Li S, Jain AK (eds) Encyclopedia of biometrics, ISBN 978-3-642-27733-7 (online). Springer Science + Business Media New York
Impedovo D, Pirlo G (2008) Automatic signature verification - the state of the art. IEEE Trans Syst Man Cybern 38(5):609–635
Iwai Y, Shimizu H, Yachida M (1999) Real-time context-based gesture recognition using hmm and automaton. In: Proceedings of the international workshop on recognition, analysis, and tracking of faces and gestures in real-time systems, pp 127–134
Jaeger S, Manke S, Waibel A (2000) Npen++ an on-line handwriting recognition system. In: 7th international workshop on frontiers in handwriting recognition, pp 249–260
Jain A, Griess F, Colonnel S (2002) On-line signature verification. Pattern Recogn 35:2963–2972
Jambhale S, Khaparde A (2014) Gesture recognition using dtw amp; piecewise dtw. In: Proceedings of the international conference on electronics and communication systems, pp 1–5
Justino E, El Yacoubi A, Bortolozzi F, Sabourin R (2000) An off-line signature verification system using hidden markov model and cross-validation. In: Proceedings of the XIII Brazilian symposium on computer graphics and image processing, pp 105–112
Kashi R, Hu J, Nelson W, Turin W (1997) On-line handwritten signature verification using hidden markov model features. In: Proceedings of the 4th international conference on document analysis and recognition, vol 1, pp 253–257
Latecki L, Megalooikonomou V, Wang Q, Yu D (2007) An elastic partial shape matching technique. Pattern Recogn 40(11):3069–3080
Lee L, Berger T, Aviczer E (1996) Reliable on-line signature verification systems. IEEE Trans Pattern Anal Mach Intell 18(6):643–649
Li Q, Zhou X, Gu A, Li Z, Liang R (2016) Nuclear norm regularized convolutional Max Pos@ Top machine. Neural Comput & Applic 1–10
Liang R, Shi L, Wang H, Meng J, Wang J, Sun Q, Gu Y (2016) Optimizing top precision performance measure of content-based image retrieval by learning similarity function. In: 23rd international conference on pattern recognition (ICPR), pp 2954–2958
Liang R, Xie W, Li W, Wang H, Wang JJ, Taylor L (2016) A novel transfer learning method based on common space mapping and weighted domain matching. In: 28th international conference on tools with artificial intelligence (ICTAI). IEEE
Mohandes M, Aliyu S, Deriche M (2014) Arabic sign language recognition using the leap motion controller. In: Proceedings of the 23rd international symposium on industrial electronics. IEEE, pp 960–965
Nakanishi I, Sakamoto H, Nishiguchi N, Itoh Y, Fukui Y (2006) Multimatcher on-line signature verification system in dwt domain. IEICE Trans Fundam 178–185
Nguyen V, Blumenstein M, Leedham G (2009) Global features for the off-line signature verification problem. In: Proceedings of the international conference on document analysis and recognition, pp 1300–1304
Rabiner L (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286
Rashid O, Al-Hamadi A, Michaelis B (2009) A framework for the integration of gesture and posture recognition using hmm and svm. In: Proceedings of the IEEE international conference on intelligent computing and intelligent systems, vol 4, pp 572–577
Roy P, Bhowmick S, Pal U, Ramel JY (2012) Signature based document retrieval using GHT of background information. In: Proceedings of the 13th international conference on frontiers in handwriting recognition, pp 225–230
Sabourin R, Genest G, Preteux F (1997) Off-line signature verification by local granulometric size distributions. IEEE Trans Pattern Anal Mach Intell 19(9):976–988
Shanker A, Rajagopalan A (2007) Off-line signature verification using dtw. Pattern Recognit Lett 28(12):1407–1414
Shrivastava R (2013) A hidden Markov model based dynamic hand gesture recognition system using opencv. In: Proceedings of the IEEE 3rd international advance computing conference, pp 947– 950
Vamsikrishna KM, Dogra DP, Desarkar MS (2016) Computer-vision-assisted palm rehabilitation with supervised learning. IEEE Trans Biomed Eng 63(5):991–1001
Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden markov model. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 379–385
Zhang Z, Xu Y, Yang J, Li X, Zhang D (2015) A survey of sparse representation: algorithms and applications. IEEE Access 490–530
Zou M, Tong J, Lou Z, Liu C (2003) On-line signature verification using improved segmentation. In: Proceedings of the IEEE international conference on systems, man and cybernetics, vol 1, pp 256– 261
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Behera, S.K., Dogra, D.P. & Roy, P.P. Analysis of 3D signatures recorded using leap motion sensor. Multimed Tools Appl 77, 14029–14054 (2018). https://doi.org/10.1007/s11042-017-5011-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5011-4