Skip to main content

Advertisement

Log in

Hand posture and gesture recognition techniques for virtual reality applications: a survey

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Motion recognition is a topic in software engineering and dialect innovation with a goal of interpreting human signals through mathematical algorithm. Hand gesture is a strategy for nonverbal communication for individuals as it expresses more liberally than body parts. Hand gesture acknowledgment has more prominent significance in planning a proficient human computer interaction framework, utilizing signals as a characteristic interface favorable to circumstance of movements. Regardless, the distinguishing proof and acknowledgment of posture, gait, proxemics and human behaviors is furthermore the subject of motion to appreciate human nonverbal communication, thus building a richer bridge between machines and humans than primitive text user interfaces or even graphical user interfaces, which still limits the majority of input to electronics gadget. In this paper, a study on various motion recognition methodologies is given specific accentuation on available motions. A survey on hand posture and gesture is clarified with a detailed comparative analysis of hidden Markov model approach with other classifier techniques. Difficulties and future investigation bearing are also examined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Aggarwal JK, Cai Q (1997) Human motion analysis: a review. In: Proceedings of the IEEE non-rigid and articulated motion workshop, pp 99–102

  • Aggarwal J, Ryoo MS (2011) Human activity analysis: a review. ACM Comput Surv 43(3):16

    Article  Google Scholar 

  • Aggarwal JK, Cai Q, Liao W, Sabata B (1994) Articulated and elastic non-rigid motion: a review. In: Proceedings of the IEEE workshop on motion of non-rigid and articulated objects, pp 2–14

  • Bansal M, Saxena S, Desale D, Jadhav D (2011) Dynamic gesture recognition using hidden Markov models in static background. Int J Comput Sci 8(6), no. 1, 391–398

  • Bashyal S, Venayagamoorthy GK (2008) Recognition of facial expressions using Gabor wavelets and learning vector quantization. Eng Appl Artif Intell 21:10

    Article  Google Scholar 

  • Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy C-means clustering algorithm. Comput Geosci 10(2–3):191–203

    Article  Google Scholar 

  • Billinghurst M (1998) Put that where? Voice and gesture at the graphics interface. SIGGRAPH Comput Graph 32(4):60–63

    Article  Google Scholar 

  • Bolt RA (1980) Put that-there: voice and gestures at the graphics interface. In: SIGGRAPH 80: 7th annual conference on computer graphics and interactive techniques. ACM Press, New York, pp 262–270

  • Bowman D (2002) Principles for the design of performance-oriented interaction techniques. In: Stanney KM (ed) Handbook of virtual environments: design, implementation, and applications. Lawerence Erlabum Associates, Hillsdale, pp 201–207

    Google Scholar 

  • Buchmann V, Violich S, Billinghurst M, Cockburn A (2004) FingAR-tips: gesture based direct manipulation in augmented reality. In: GRAPHITE’04, 2nd international conference on graphics and interactive techniques in Australis and South East Asia. ACM Press, New York, pp 212–221

  • Candamo J, Shreve M, Goldgof DB, Sapper DB, Kasturi R (2010) Understanding transit scenes: a survey on human behavior recognition algorithms. IEEE Trans Intell Transp Syst 11(1):206–224

    Article  Google Scholar 

  • Cedras C, Shah M (1995) Motion based recognition: a survey. Image Vis Comput 13(2):129–155

    Article  Google Scholar 

  • Chaquet JM, Carmona EJ, Fernandez-Caballero A (2013) A survey of video datasets for human action and activity recognition. Comput Vis Image Underst 117(6):633–659

    Article  Google Scholar 

  • Chen FS, Fu CM, Huang CL (2003) Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis Comput 21:745–758

    Article  Google Scholar 

  • Chen Q, Georganas ND, Petriu EM (2008) Hand gesture recognition using Haar-like features and a stochastic context-free grammar. IEEE Trans Instrum Meas 57(8):1562–1571

    Article  Google Scholar 

  • Chen L, Wei H, Ferryman J (2013) A survey of human motion analysis using depth imagery. Pattern Recognit Lett 34(15):1995–2006

    Article  Google Scholar 

  • Chong Y, Huang J, Pan S (2016) Hand Gesture recognition using appearance features based on 3D point cloud. J Softw Eng Appl 9:103–111

    Article  Google Scholar 

  • Chung KYC (2010) Facial expression recognition by using class mean gabor responses with kernel principal component analysis M.Sc Thesis, Russ College of Engineering and Technology, Ohio University, USA, pp 1–69

  • Chung WK, Wu X, Xu Y (2009) A real-time hand gesture recognition based on haar wavelet representation. In: Proceedings of the IEEE international conference on robotics and biometrics (ROBIO’08), Bangkok, Thailand, pp 336–341

  • Conte D, Foggia P, Sansone C, Vento M (2004) Thirty years of graph matching in pattern recognition. Int J Pattern Recognit Artif Intell 18(3):265–298

    Article  Google Scholar 

  • Cristani M, Raghavendra R, Del Bue A, Murino V (2013) Human behavior analysis in video surveillance: a social signal processing perspective. Neuro Comput 100:86–97

    Google Scholar 

  • Dardas NH, Georganas ND (2011) Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques. IEEE Trans Instrum Meas 60(11):3592–3607

    Article  Google Scholar 

  • Dominio F, Donadeo M, Zanuttigh P (2014) Combining multiple depth-based descriptors for hand gesture recognition. Pattern Recognit Lett 101–111

  • Elmezai M, Al-Hamadi A, Krell G, El-Etriby S, Michaelis B (2007) Gesture recognition for alphabets from hand motion trajectory using hidden markov models. In: Proceeding of IEEE international symposium on signal processing and information technologies

  • Fels SS, Hinton GE (1993) Glove-talk: a neural network interface between a data-glove and a speech synthesizer. IEEE Trans Neural Netw 4(1):2–8. doi:10.1109/72.182690

    Article  Google Scholar 

  • Fels SS, Hinton GE (1998) Glove-talk: a neural network interface which maps gestures to parallel formant speech synthesizer controls. IEEE Trans Neural Netw 9(1):205–212. doi:10.1109/72.655042

    Article  Google Scholar 

  • Feng Zhiquan, Yang Bo, Chen Yuehui, Zheng Yanwei, Tao Xu, Li Yi, Ting Xu (2011) Deliang Zhu. Features extraction from hand images based on new detection operators, Pattern Recognit, pp 1089–1105

    Google Scholar 

  • Foxlin E (2002) Motion tracking requirements and technologies. In: Stanney KM (ed) Handbook of virtual environments: design, implementation, and applications. Lawrence Erlbaum Associates, Hillsdale, pp 163–210

    Google Scholar 

  • Freeman WT, Roth M (1995) Orientation histograms for hand gesture recognition. In: IEEE international workshop on automatic face and gesture recognition, Zurich

  • Gabbard J (1997) A taxonomy of usability characteristics in virtual environments. Master’s thesis, Department of Computer Science, University of Western Australia

  • Gavrila DM (1999) The visual analysis of human movement: a survey. Comput Vis Image Underst 73(1):82–98

    Article  MATH  Google Scholar 

  • Ge SS, Yang Y, Lee TH (2008) Hand gesture recognition and tracking based on distributed locally linear embedding. Image Vis Comput 26:1607–1620

    Article  Google Scholar 

  • Guo G, Lai A (2014) A survey on still image based human action recognition. Pattern Recognit 47:3343–3361

    Article  Google Scholar 

  • Gupta A, Sehrawat VK, Khosla M (2012) FPGA based real time human hand gesture recognition system. In: 2nd international conference on communication, computing and security, pp 98–107

  • Heap T, Hogg D (1996) Towards 3D hand tracking using a deformable model. In: Proceeding IEEE 2nd international conference on automatic face and gesture recognition

  • Holte MB, Tran C, Trivedi MM, Moeslund TB (2011) Human action recognition using multiple view: a comparative perspective on recent developments. In: Proceedings of the joint ACM workshop on human gesture and behavior understanding, pp 47–52

  • Hu W, Tan T, Wangs L, Maybank S (2004) A survey on visual surveillance of object motion and behaviors. IEEE Trans Syst Man Cybern C Appl Rev 34(3):334–352

    Article  Google Scholar 

  • Huang Z et al (2010) Study of sign language recognition based on Gabor wavelet transforms. In: International conference on computer design and applications

  • Huang DY, Hu WC, Chang SH (2011) Gabor filter-based hand pose angle estimation for hand gesture recognition under varying illumination. Expert Syst Appl 38(5):6031–6042

    Article  Google Scholar 

  • Ibarguren A, Maurtua I, Sierra B (2010) Layered architecture for real time sign recognition: hand gesture and movement. J Eng Appl Artif Intell 1216–1228

  • Jain AK, Duta N (1999) Deformable matching of hand shapes for verification. In: Proceedings of international conference on image processing

  • Jain AK, Ross A, Pankanti S (1999) A prototype hand geometry based verification system. In: Proceedings of 2nd international conference on audio and video based biometric person authentication, pp 166–171

  • Jemaa YB, Khanfir S (2009) Automatic local Gabor features extraction for face recognition. Int J Comput Sci Inf Secur 3:1–7

    Google Scholar 

  • Ji X, Liu H (2010) Advances in view-invariant human motion analysis: a review. IEEE Trans Syst Man Cybern C Appl Rev 40(1):13–24

    Google Scholar 

  • Joshi A, Monnier C, Betke M, Sclaroff S (2016) Comparing random forest approaches to segmenting and classifying gestures. J Image Vis Comput 1–10. doi:10.1016/j.imavis.2016.06.001

  • Just A, Marcel S (2009) A comparative study of two-state-of-the art sequence processing techniques for hand gesture recognition. Comput Vis Image Underst 113(4):532–543

    Article  Google Scholar 

  • Karami A, Zanj B, Sarkaleh AK (2011) Persian sign language (PSL) recognition using wavelet transform and neural networks. Expert Syst Appl 38:2661–2667

    Article  Google Scholar 

  • Keskin C, Erkan A, Akarun L (2003) Real time hand tracking and 3D gesture recognition for interactive interface using HMM. In: Proceedings of international conference on artificial neural networks

  • Khaled H, Sayed SG, Saad ESM, Ali H (2015) Hand gesture recognition using modified 1$ and background subtraction algorithms. J Math Probl Eng 2015:1–8

    Google Scholar 

  • Kiliboz NC, Gudukbay U (2015) A hand gesture recognition technique for human–computer interaction. J Vis Commun Image Recognit 28:97–104

    Article  Google Scholar 

  • Kim D, Song J, Kim D (2007) Simultaneous gesture segmentation and recognition based on forward spotting accumulative HMMs. Pattern Recognit 40(11):3012–3026

    Article  MATH  Google Scholar 

  • Kohler M, Schroter S (1998) A survey of video-based gesture recognition: stereo and mono systems. Technical report no. 693/1998, Informatik VII, University of Dortmund

  • Koike H, Sato Y, Kobayashi Y (2001) Integrating paper and digital information on enhanced desk: a method for real time finger tracking on an augmented desk system. ACM Trans Hum Comput Interact 8(4):307–322

    Article  Google Scholar 

  • Kolsch M, Turk M (2004) Robust hand detection. In: 6th IEEE international conference on automatic face and gesture recognition, vol 614

  • Koons DB, Sparrell CJ (1994) Iconic: speech and depictive gestures at the human-machine interface. In: CHI’94: conference companion on human factors in computing systems. ACM Press, New York, pp 453–454

  • Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209

    Article  Google Scholar 

  • LaViola JJ Jr (1999) A survey of hand posture and gesture recognition and technology. Master thesis, NSF Science and Technology Center for Computer Graphics and Scientific Visualization, USA

  • Lay YL (2000) Hand shape recognition. Opt Laser Technol 32(1):1–5

    Article  MathSciNet  Google Scholar 

  • Lee KH, Kim JH (1999) An HMM based threshold model approach for gesture recognition. IEEE Trans Pattern Anal Mach Intell 21(10):961–973

    Article  Google Scholar 

  • Lee D, Nakamura Y (2014) Motion recognition and recovery from occluded monocular observations. J Robot Auton Syst 62:818–832

    Article  Google Scholar 

  • Lenman S, Bretzner L, Thuresson B (2002) Using marking menus to develop command sets for computer vision based hand gesture interfaces. In: NordiCHI’02: second nordic conference on human computer interaction. ACM Press, New York, pp 239–242

  • Letessier J, Berard F (2004) Visual tracking of bare fingers for interactive surfaces. In: UIST’04: 17th annual ACM symposium on user interface software and technology. ACM Press, New York, pp 119–122

  • Li X (2003) Gesture recognition based on fuzzy C-means clustering algorithm. Department of Computer Science, The University of Tennessee, Knoxville

  • Li YT, Wachs JP (2014) HEGM: A hierarchical elastic graph matching for hand gesture recognition. Pattern Recognit 47(1):80–88

    Article  Google Scholar 

  • Li C, Zhani P, Zheng S, Prabhakaran B (2004) Segmentation and recognition of multi-attribute motion sequences. In: Proceedings of the ACM multimedia conference, pp 836–843

  • Li S-Z, Yu B, Wu W, Su S-Z, Ji R-R (2015) Feature learning based on SAE–PCA network for human gesture recognition in RGBD images. J Neuro Comput 151:565–573

    Google Scholar 

  • Licsar A, Sziranyi T (2004) Dynamic training of hand gesture recognition system. In: Kittler J, Petrou M, Nixon M (eds) Proceedings of international conference on pattern recognition. ICPR, Cambridge, pp 971–974

    Google Scholar 

  • Licsar A, Sziranyi T (2005) User-adaptive hand gesture recognition system with interactive training. Image Vis Comput 23:1102–1114

    Article  Google Scholar 

  • Lim CH, Vats E, Chan CS (2015) Fuzzy human motion analysis: a review. J Pattern Recognit 48:1773–1796

    Article  Google Scholar 

  • Litchtenauer JF, Hendriks EA, Reinders MJT (2008) Sign language recognition by combining statistical IDTW and independent classification. IEEE Trans Pattern Anal Mach Intell 30(11):2040–2046

    Article  Google Scholar 

  • Liu C (2004) Gabor-Based Kernel PCA with fractional power polynomial models for face recognition. IEEE Trans Pattern Anal Mach Intell 26:10

    Google Scholar 

  • Liu A, Tendick F, Clearly K, Kaufmann C (2003) A survey of surgical simulation: applications, technology and education. Presence Teleoper Virtual Environ 12(6):599–614

    Article  Google Scholar 

  • Malik S, Laszlo J (2004) Visual touchpad: a two-handed gestural input device. In: ICMI’04: 6th international conference on multimodal interfaces. ACM Press, New York, pp 289–296

  • Maraqa M, Abu-Zaiter R (2008) Recognition of Arabic Sign Language (ArSL) using recurrent neural networks. In: IEEE 1st international conference on the applications of digital information and web technologies, pp 478–484. doi:10.1109/ICADIWT.2008.4664396

  • Marcel S, Bernier O (1999) Hand posture recognition in bady faced centered space. In: Proceeding of the international gesture workshop, Gif-sur-Yvette, France

  • Martin J, Devin V, Crowley JL (1998) Active hand tracking. In: FG’98: 3rd international conference on face & gesture recognition. IEEE Computer Society, Washington, p 573

  • Maung TH (2009) Real-time hand tracking and gesture recognition system using neural networks. World Acad Sci Eng Technol 50:466–470

    Google Scholar 

  • Meena S (2011) A study on hand gesture recognition technique. Master thesis, Department of Electronics and Communication Engineering, National Institute of Technology, India

  • Mitra S, Acharya T (2003) Data mining: multimedia, soft computing, and bioinformatics. Wiley, New York

    Google Scholar 

  • Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern C Appl Rev 37(3):311–324. doi:10.1109/TSMCC

    Article  Google Scholar 

  • Mo Z, Lewis JP, Neumann U (2005) Smartcanvas: a gesture-driven intelligent drawing desk system. In: IUI’05: 10th international conference on intelligent user interfaces. ACM Press, New York, pp 239–243

  • Moeslund TB, Hilton A, Kruger V (2001) A survey of computer vision-based human motion capture. Comput Vis Image Underst 81(3):231–268

    Article  MATH  Google Scholar 

  • Moeslund TB, Hilton A, Kruger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104(2):90–126

    Article  Google Scholar 

  • Murakami K, Taguchi H (1999) Gesture recognition using recurrent neural networks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, pp 237–242. doi:10.1145/108844.108900

  • Mutha SS, Kinage K (2015) Hand Gesture recognition using LAB thresholding technique. In: 4th post graduate conference (iPGCON-2015), pp 1–5

  • Ng CW, Ranganath S (2002) Real-time gesture recognition system and application. Image Vis Comput 20:993–1007

    Article  Google Scholar 

  • Nguyen-Duc-Thanh N, Lee S, Kim D (2012) Two-stage hidden Markov model in gesture recognition for human robot interaction. Int J Adv Robot Syst 9:1–10

    Article  Google Scholar 

  • Nielsen M, Storring M, Moeslund TB, Granum E (2003) A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: 5th international gesture workshop, pp 409–420

  • Oden C, Ercil A, Buke B (2003) Combining implicit polynomials and geometric features for hand recognition. Pattern Recognit Lett 24:2145–2152

    Article  Google Scholar 

  • Oka K, Sato Y, Koike H (2002) Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems. In: FGR’02: 5th IEEE international conference on automatic face and gesture recognition. IEEE Computer Society, Washington, p 429

  • Ong EJ, Bowden R (2004) A boosted classifier tree for hand shape detection. In: 6th IEEE international conference on automatic face and gesture recognition, pp 889–894

  • Patwardhan KS, Roy SD (2007) Hand gesture modeling and recognition involving changing shapes and trajectories using a predictive eigen tracker. Pattern Recognit 28:329–334

    Article  Google Scholar 

  • Pavlovic VI, Sharma R, Huang TS (1997) Visual interpretation of hand gestures for human computer interaction. IEEE Trans Pattern Anal Mach Intell 19(7):677–695

    Article  Google Scholar 

  • Pentland A (2000) Looking at people: sensing for ubiquitous and wearable computing. IEEE Trans Pattern Anal Mach Intell 22(1):107–119

    Article  Google Scholar 

  • Pisharady PK, Saerbeck M (2015) Recent methods and databases in vision-based hand gesture recognition: a review. J Comput Vis Image Underst 141:152–165

    Article  Google Scholar 

  • Pisharady PK, Vadakkepat P, Loh AP (2010a) Hand posture and face recognition using a fuzzy-rough approach. Int J Humanoid Robot 7(3):331–356

    Article  Google Scholar 

  • Pisharady PK, Vadakkepat P, Loh AP (2010) Graph matching based hand pose recognition using neuro-biologically inspired features. In: Proceedings of international conference on control, automation, robotics and vision, ICARCV, Singapore

  • Pisharady PK, Vadakkepat P, Loh AP (2013) Attention based detection and recognition of hand posture against complex backgrounds. Int J Comput Vis 101(3):403–419

    Article  Google Scholar 

  • Poppe R (2007) Vision-based human motion analysis: an overview. Comput Vis Image Underst 108(1):4–18

    Article  Google Scholar 

  • Poppe R (2010) A survey on vision-based human action recogntion. Comput Vis Image Underst 28(6):976–990

    Article  Google Scholar 

  • Qin S, Zhu X, Yang Y, Jiang Y (2014) Real-time hand gesture recognition from depth images using convex shape decomposition method. J Signal Process Syst 74:47–58

    Article  Google Scholar 

  • Quck F, MeNeill D, Bryll R, Duncan S, Ma X-F, Kirbas C, McCullough KE, Ansari R (2002) Multimodal human discourse: gesture and speech. ACM Trans Comput Hum Interact 9(3):171–193

    Article  Google Scholar 

  • Quek FKH (1996) Unencumbered gestural interaction. IEEE Multimed 3(4):36–47

    Article  Google Scholar 

  • Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech reognition. Proc IEEE 77(2):257–285

    Article  Google Scholar 

  • Ramamoorthy A, Vaswani N, Chaudhury S, Banerjee S (2003) Recognition of dynamic hand gestures. Pattern Recognit 36:2069–2081

    Article  MATH  Google Scholar 

  • Ren Y, Gu C (2010) Real-time hand gesture recognition based on vision. In: Proceedings of the 5th international conference on E-learning and games, Edutainment, Changchun, China

  • Ren Z, Yuan J, Zhang Z (2011) Robust hand gesture recognition based on finger-earth mover’s distance with a commodity depth camera. In: ACM international conference on multimedia, Scottsdlae, pp 1093–1096

  • Roweis ST, Saul LK (2000) Non linear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

    Article  Google Scholar 

  • Sanches-Reillo R, Sanchez-Avila C, Gonzalez-Macros A (2000) Biometric identification through hand geometry measurements. IEEE Trans Pattern Anal Mach Intell 22(10):1168–1171

    Article  Google Scholar 

  • Segen J, Kumar S (1998) Gesture VR: vision-based 3D hand interface for spatial interaction. In: 6th ACM international conference on multimedia. ACM Press, New York, pp 455–464

  • Shin MC, Tsap LV, Goldgof DB (2004) Gesture recognition using Bezier curves for visualization navigation from registered 3D data. Pattern Recognit 37(5):1011–1024

    Article  Google Scholar 

  • Starner T, Pentland A (1995) Visual recognition of American sign language using hidden Markov models. In: Proceeding of international workshop on automatic face and gesture recognition, Zurich, Switzerland

  • Starner T, Pentland A (1996) Real-time american sign language recognition from video using hidden Markov models. AAAI technical report FS-96-05, The Media Laboratory Massachusetts Institute of Technology

  • Stenger B, Thayananthan A, Torr P, Cipolla R (2004) Hand pose estimation using hierarchical detection. In: 8th European conference on computer vision workshop on human computer interaction, vol 3058, Springer, Prague, pp 102–112

  • Stergiopoulou E, Papmarkos N (2009) Hand gesture recognition using a neural shape fitting technique. J Eng Appl Artif Intell 22:1141–1158

    Article  Google Scholar 

  • Sturman DJ (1992) Whole hand input. Ph.D. thesis, MIT

  • Sturman DJ, Zeltzer D (1994) A survey of glove-based input. IEEE Comput Graph Appl 14(1):30–39

    Article  Google Scholar 

  • Su C-J, Chiang C-Y, Huang J-Y (2014) Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic. J Appl Soft Comput 22:652–666

    Article  Google Scholar 

  • Suk HI, Sin BK, Lee SW (2010) Hand gesture recognition based on dynamic Bayesian network framework. Pattern Recognit 43(9):3059–3072

    Article  MATH  Google Scholar 

  • Teng X, Wu B, Yu W, Liu C (2005) A hand gesture recognition system based on locally linear embedding. J Vis Lang Comput 16:442–454

    Article  Google Scholar 

  • Travieso CM, Ticay-Rivas JR, Briceno JC, del Pozo-Banos M (2014) Hand shape identification on multirange images. J Inf Sci 275:45–56

    Article  Google Scholar 

  • Triesch J, Malsburg C (2001) A system for person-independent hand posture recognition against complex backgrounds. IEEE Trans Pattern Anal Mach Intell 23(12):1449–1453

    Article  Google Scholar 

  • Turaga P, Chellappa R, Subrahmanian VS, Udrea O (2008) Machine recognition of human activities: a survey. IEEE Trans Circuits Syst Video Technol 18(11):1473–1488

    Article  Google Scholar 

  • Turk M (2002) Gesture recognition. In: Stanney KM (ed) Handbook of virtual environments: design, implementation, and applications. Lawerence Erlbaum Associates, Hillsdale, pp 223–238

    Google Scholar 

  • Ueda E, Matsumoto Y, Imai M, Ogasawara T (2003) A hand-pose estimation for vision-based human interfaces. IEEE Trans Ind Electron 50(4):676–684

    Article  Google Scholar 

  • Virtual Glove Box (VGX) (2016). http://biovis.arc.nasa.gov/vislab/vgx.htm

  • Vo N, Tran Q, Dinh TB, Dinh TB, Nguyen QM (2010) An efficient human–computer interaction framework using skin color tracking and gesture recognition. In: Proceedings of IEEE international conference on computing and Communication Technologies, Research, Innovation, and Vision for the Future, pp 978–981. doi:10.1109/RIVF.2010.5633368

  • Wang L, Hu W, Tan T (2003) Recent development of human motion analysis. Pattern Recognit 36(3):585–601

    Article  Google Scholar 

  • Wang L et al (2008) 2D Gabor face representation method for face recognition with ensemble and multichannel model. Image Vis Comput 26:9

    Google Scholar 

  • Wexelblat A (1995) An approach to natural gesture in virtual environments. ACM Trans Comput Hum Interact 2(3):179–200

    Article  Google Scholar 

  • Wienland D, Ronfard R, Boyer E (2011) A survey of vision-based methods for action representation, segmentation and recognition. Comput Vis Image Underst 115(2):224–241

    Article  Google Scholar 

  • Wiskott L, Fellous JM, Kruger N, Malsburg C (1997) Face recognition by elastic bunch graph matching. IEEE Trans Pattern Anal Mach Intell 19(7):775–779

    Article  Google Scholar 

  • Wysoski SG (2003) A rotation invariant static hand gesture recognition system using boundary information and neural networks. ME thesis, Nagoya Institute of Technology, Japan

  • Wysoski SG, Lamar MV, Kuroyanagi S, Iwata A (2002) A rotation invariant approach on static-gesture recognition using boundary histograms and neural networks. In: IEEE proceedings of the 9th international conference on neural information processing, Singapura

  • Xu W et al (2009) A scale and rotation invariant interest points detector based on Gabor filters. In: Slezak D, Pal S, Kang BH, Gu J, Kuroda H, Kim TH (eds) Signal processing image processing and pattern recognition. Communications in computer and information science, vol 61. Springer, Berlin, p 8

  • Yang MH, Ahuja N, Tabb M (2002) Extraction of 2D motion trajectories and its application to hand gesture recognition. IEEE Trans Pattern Anal Mach Intell 24(8):1061–1074

    Article  Google Scholar 

  • Yeasin M, Chaudhuri S (2000) Visual understanding of dynamic hand gestures. Pattern Recognit 33(11):1805–1817

    Article  Google Scholar 

  • Yewale SK (2011) Artificial neural network approach for hand gesture recognition. Int J Eng Sci Technol IJEST 34:2603–2608

    Google Scholar 

  • Yikai F, Kongqiao W, Jian C, Hanquing L (2007) A real-time hand gesture recognition method. In: Proceeding of the IEEE international conference on mutlimedia and expo (ICME’07), Beijing, China, pp 995–998

  • Yin X, Xie M (2003) Estimation of the fundamental matrix from un-calibrated stereo hand images for 3D hand gesture recognition. Pattern Recognit 36:567–584

    Article  Google Scholar 

  • Yoon HS, Soh J, Bae YJ, Yang HS (2001) Hand gesture recognition using combined features of location, angle and velocity. J Pattern Recognit 34:1491–1501

    Article  MATH  Google Scholar 

  • Yun L, Peng Z (2009) An automatic hand gesture recognition system based on Viola–Jones method and SVM’s. In: Proceedings of the 2nd international workshop on computer science and engineering (WCSE’09), pp 72–76

  • Zaiden AA, Ahmad NN, Abdul Karim H, Larbani M, Zaidan BB, Sali A (2014) Image skin segmentation based on multi-agent learning Bayesian and neural network. Eng Appl Artif Intell 32:136–150

    Article  Google Scholar 

  • Zhao M, Quek FKH, Wu X (1998) RIEVL: recursive induction learning in hand gesture recognition. IEEE Trans Pattern Anal Mach Intell 20(11):1174–1185

    Article  Google Scholar 

  • Zhou H, Lin DJ, Haung TS (2004) Static hand gesture recognition based on local orientation histogram feature distribution model. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition workshops

  • Zhu C, Sheng W (2009) Online hand gesture recognition using neural network based segmentation. In: International conference on intelligent robots and systems. IEEE Publisher, pp 2415–2420

  • Zunkel RL (1999) Hand geometry based verification. In: Proceedings of biometrics. Kluwer Academic Publishers, pp 87–101

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to D. Jude Hemanth.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sagayam, K.M., Hemanth, D.J. Hand posture and gesture recognition techniques for virtual reality applications: a survey. Virtual Reality 21, 91–107 (2017). https://doi.org/10.1007/s10055-016-0301-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-016-0301-0

Keywords

Navigation