Abstract
This paper explores the feasibility of a contactless identification system based on hand features. The identification solution has been designed to be integrated with smart space applications and relies on a commercial 3D sensor (i.e., Leap Motion) for palm features capture. The first part of the paper is devoted to evaluate the significance of the different hand features and the performance of a set of classification algorithms. 21 users have contributed to build a testing dataset; for each user, the morphology of each hand has been gathered from 52 features, which include bones length and width, palm characteristics and relative distances among fingers, palm center and wrist. In order to get consistent samples and guarantee the best performance for Leap Motion device, the data collection system provides sweet spot control. This functionality guides the user to situate the hand in the best position and orientation with respect to the device. The selected classification strategies—nearest neighbor (NN), supported vector machine, multilayer perceptron, logistic regression and tree algorithms—have been evaluated on Weka. We have found that relative hand-pose distances are more significant than pure morphological features. On this feature set, the highest correct classified instances (CCI) rate is reached through the multilayer perceptron algorithm (>96 %), although all the evaluated classifiers provide a CCI rate above 90 %. The analysis also gather how these algorithms perform with a variable number of users in the database, and what the sensitivity to the number of training samples is for each algorithm. Results show that there are different alternatives that are accurate enough for non-critical, immediate response applications. The second part of the paper focuses on the implementation of application examples that are integrated with a real-time hand-based identification system using NN. In particular, the applications enable customization and gesture-based control of the smart space. A five-user study has provided insight into the system performance and user experience. Results confirm the viability of using in-air hand shape recognition in smart space settings, although also it is still needed to deal with aspects that hinder faster and more accurate recognition.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Available at: http://www.cs.umd.edu/~mount/ANN/.
References
Adán M, Adán A, Vázquez AS, Torres R (2008) Biometric verification/identification based on hands natural layout. Image Vis Comput 26(4):451–465
Avola D, Petracca A, Placidi G, Spezialetti M, Cinque L, Levialdi S (2014) Markerless hand gesture interface based on LEAP motion controller. In: Procs. of the international conference on distributed multimedia systems
Bergesio L, Marquinez I, Bernardos AM, Besada JA, Casar JR (2013) PERSEO: a system to personalize the environment response through smart phones and objects. In: IEEE international conference on pervasive computing and communications workshops, pp 640–645
Bernardos AM, Sánchez JM, Portillo JI, Besada JA, Casar JR (2015) A contactless identification system based on hand shape features. Procedia Comput Sci 52:161–168
de Santos-Sierra D, Arriaga-Gomez MF, Bailador G, Sanchez-Avila C (2014) Low computational cost multilayer graph-based segmentation algorithms for hand recognition on mobile phones. In: International carnahan conference on security technology (ICCST), IEEE, pp 1–5
Duta N (2009) A survey of biometric technology based on hand shape. Pattern Recogn 42(11):2797–2806
Ferrer M, Fàbregas J, Faundez M, Alonso J B, Travieso C (2009) Hand geometry identification system performance. In: 43rd annual international carnahan conference on security technology, IEEE, pp 167–171
Guna J, Jakus G, Pogačnik M, Tomažič S, Sodnik J (2014) An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14(2):3702–3720
Guo JM, Liu YF, Chu MH, Wu CC, Le TN (2011) Contact-free hand geometry identification system. In: 18th IEEE international conference image processing (ICIP), pp 3185–3188
Han J, Gold N (2014) Lessons learned in exploring the Leap Motion TM sensor for gesture-based instrument design. In: Proceedings of the international conference on new interfaces for musical expression, pp 371–374
Hassenzahl M, Tractinsky N (2006) User experience—a research agenda. Behav Inf Technol 25(2):91–917
Jain AK, Duta N (1999) Deformable matching of hand shapes for user verification. In: International conference on image processing, IEEE, Vol 2, pp 857–861
Jain AK, Flynn P, Ross AA (2007) Handbook of biometrics. Springer, Berlin
Kanhangad V, Kumar A, Zhang D (2011) Contactless and pose invariant biometric identification using hand surface. IEEE Trans Image Process 20(5):1415–1424
Kong A, Zhang D, Kamel M (2009) A survey of palmprint recognition. Pattern Recogn 42(7):1408–1418
Kumar A, Zhang D (2006) Personal recognition using hand shape and texture. IEEE Trans Image Process 15(8):2454–2461
Kumar A, Zhang D (2007) Hand-geometry recognition using entropy-based discretization. IEEE Trans Inf Forensics Secur 2(2):181–187
Kumar A, Wong DC, Shen HC, Jain AK (2003) Personal verification using palmprint and hand geometry biometric. Audio-and video-based biometric person authentication. Springer, Berlin, pp 668–678
Laugwitz B, Held T, Schrepp M (2008) Construction and evaluation of a user experience questionnaire. Springer, Berlin
Marin G, Dominio F, Zanuttigh P (2015) Hand gesture recognition with jointly calibrated Leap Motion and depth sensor. Multimed Tools Appl 1–25. doi:10.1007/s11042-015-2451-6
Miller RP (1971) Finger dimension comparison identification system. US Patent No. 3576538
Morales A, Ferrer MA, Díaz F, Alonso JB, Travieso CM (2008) Contact-free hand biometric system for real environments. In: 16th European signal processing conference, IEEE, pp 1–5
Mostayed A, Kabir ME, Khan SZ, Mazumder MG (2009) Biometric authentication from low resolution hand images using radon transform. In: 12th international conference on computers and information technology, IEEE, pp 587–592
Nielsen J, Landauer TK (1993) A mathematical model of the finding of usability problems. In: Procs. of ACM INTERCHI’93 conference, Amsterdam, The Netherlands, pp 206–213
Oden C, Ercil A, Buke B (2003) Combining implicit polynomials and geometric features for hand recognition. Pattern Recogn Lett 24(13):2145–2152
Pavešić N, Ribarić S, Ribarić D (2004) Personal authentication using hand-geometry and palmprint features–the state of the art. Hand 11:12
Ross A, Jain AK (1999) A prototype hand geometry-based verification system. In: Proceedings of 2nd conference on audio and video based biometric person authentication, pp 166–171
Sanchez-Reillo R, Sanchez-Avila C, Gonzalez-Marcos A (2000) Biometric identification through hand geometry measurements. IEEE Trans Pattern Anal Mach Intell 22(10):1168–1171
Sodhi GS, Kaur J (2003) Indian civilization and the science of fingerprinting. Indian J Tradit Knowl 2(2):126–136
Tistarelli M, Schouten B (2011) Biometrics in ambient intelligence. J Ambient Intell Humaniz Comput 2(2):113–126
Wang X, Bernardos AM, Besada JA, Metola E, Casar JR (2015) A gesture-based method for natural interaction in smart spaces. J Ambient Intell Smart Environ 7(4):535–562
Wong AL, Shi P (2002) Peg-free hand geometry recognition using hierarchical geometry and shape matching. IAPR workshop on machine vision applications, pp 281–284
Woodard DL, Flynn PJ (2005) Finger surface as a biometric identifier. Comput Vis Image Underst 100(3):357–384
Yörük E, Dutağaci H, Sankur B (2006) Hand biometrics. Image Vis Comput 24(5):483–497
Yuan Y, Barner K (2006) An active shape model based tactile hand shape recognition with support vector machines. In: 40th annual conference on information sciences and systems, IEEE, pp 1611–1616
Zheng G, Wang CJ, Boult TE (2007) Application of projective invariants in hand geometry biometrics. IEEE Trans Inf Forensics Secur 2(4):758–768
Acknowledgments
This work has been supported by the Spanish Ministry of Economy and Competitiveness under grant TEC2014-55146-R and by the Technical University of Madrid under grant RP150955017.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bernardos, A.M., Sánchez, J.M., Portillo, J.I. et al. Design and deployment of a contactless hand-shape identification system for smart spaces. J Ambient Intell Human Comput 7, 357–370 (2016). https://doi.org/10.1007/s12652-016-0363-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-016-0363-6