skip to main content
research-article

Digital Human Models in Human Factors and Ergonomics Evaluation of Gesture Interfaces

Authors Info & Claims
Published:19 June 2018Publication History
Skip Abstract Section

Abstract

Gesture-based interfaces are becoming a widely used interaction modality in many industrial applications. Therefore, it is important to guarantee usable and ergonomic interfaces for workers. The purpose of this study was to investigate whether the use of digital human models (DHMs) by human factors/ergonomics (HFE) experts can complement the user evaluation of gesture interface prototypes. Two case studies were conducted, in which gesture-based systems for remote robot control were evaluated. The results indicate that the use of DHMs supports the findings from self-reported HFE evaluations. However, digital human modeling still has some limitations. For example, in this study, it was not possible to evaluate small muscle groups (e.g. fingers). We argue that adaptation of the DHMs could be a rapid and simple alternative for supporting the HFE design of gestures.

References

  1. Iina Aaltonen, Susanna Aromaa, Kaj Helin, and Ali Muhammad. 2017. Multimodality Evaluation Metrics for Human-Robot Interaction Needed?: A Case Study in Immersive Telerobotics. Proceedings of the 8th International Conference on Applied Human Factors and Ergonomics (AHFE 2017), 335--347.Google ScholarGoogle Scholar
  2. Norman Badler. 1997. Virtual humans for animation, ergonomics, and simulation. Proceedings IEEE Nonrigid and Articulated Motion Workshop: 28--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Norman I. Badler, Cary B. Phillips, and Bonnie L. Webber. 1993. Simulating Humans: Computer Graphics, Animation, and Control. . Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Thomas Baudel and Michel Beaudouin-Lafon. 1993. Remote control of objects using free-hand gestures. Communications of the ACM 36, 7: 28--35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gunnar A. Borg. 1982. Psychophysical bases of perceived exertion. Med sci sports exerc 14, 5: 377--381.Google ScholarGoogle Scholar
  6. Marcio C. Cabral, Carlos H. Morimoto, and Marcelo K. Zuffo. 2005. On the usability of gesture interfaces in virtual reality environments. Proceedings of the Latin American conference on Human-computer interaction (CLIHC '05), 100--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Db Chaffin. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Shao-Wen Chang and Mao-Jiun J. Wang. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ken Tin-kai Chen. 2009. An Investigation Into Alternative Human-Computer Interaction in Relation To Ergonomics for Gesture Interface Design. Dissertation.Google ScholarGoogle Scholar
  10. Ngip Khean Chuan, Ashok Sivaji, and Wan Fatimah Wan Ahmad. 2014. Proposed Usability Heuristics for Testing Gestural Interaction. In Proceedings of the International Conference on Artificial Intelligence and Applications in Engineering and Technology, 233--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Herbert A. Colle and Gary B. Reid. 2005. Estimating a Mental Workload Redline in a Simulated Air-to-Ground Combat Mission. The International Journal of Aviation Psychology 15, 4: 303--319.Google ScholarGoogle ScholarCross RefCross Ref
  12. G C David. 2005. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occupational medicine (Oxford, England) 55, 3: 190--199.Google ScholarGoogle Scholar
  13. William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing guiding systems for gesture-based interaction. Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS '15, ACM, 44--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. H.O. Demirel and V.G. Duffy. 2007. Application of digital human modeling in industry. Digital Human Modeling: 824--832. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. European Agency for Safety and Health at Work. 2007. Work-related musculoskeletal disorders (MSDs): an introduction.Google ScholarGoogle Scholar
  16. European Commission. 2014. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions on a EU Strategic Framework on Health and Safety at Work 2014--2020. 15. Retrieved March 24, 2016 from http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:No+Title#0.Google ScholarGoogle Scholar
  17. Scott S. Fisher, Michael McGreevy, Jeffrey Humphries, and Warren Robinett. 1987. Virtual environment display system. In Proceedings of the 1986 workshop on Interactive 3D graphics, 77--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Paul M. Fitts. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Biology 47, 6: 381--391.Google ScholarGoogle Scholar
  19. Lars Fritzsche. 2010. Ergonomics risk assessment with digital human models in car assembly: simulation versus real life. Human Factors and Ergonomics in Manufacturing & Service Industries 20, 4: 287--299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Lars Hanson, Mikael Blomé, Tania Dukic, and Dan Högberg. 2006. Guide and documentation system to support digital human modeling applications. International Journal of Industrial Ergonomics 36, 1: 17--24.Google ScholarGoogle ScholarCross RefCross Ref
  21. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52: 139--183.Google ScholarGoogle Scholar
  22. Sue Hignett and Lynn Mcatamney. 2000. Rapid entire body assessment (REBA). Applied Ergonomics 31: 201--205.Google ScholarGoogle ScholarCross RefCross Ref
  23. Eve Hoggan, Miguel Nacenta, Per Ola Kristensson, John Williamson, Antti Oulasvirta, and Anu Lehtiö. 2013. Multi-Touch Pinch Gestures: Performance and Ergonomics. In Proceedings of the ACM international conference on Interactive tabletops and surfaces, 219--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Eve Hoggan, John Williamson, Antti Oulasvirta, Miguel Nacenta, Per Ola Kristensson, and Anu Lehtiö. 2013. Multi-Touch Rotation Gestures: Performance and Ergonomics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3047--3050. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. IEA. 2000. Definition and domains of ergonomics. Retrieved January 15, 2016 from http://www.iea.cc/whats/.Google ScholarGoogle Scholar
  26. Osmo Karhu, Pekka Kansi, and Ilkka Kuorinka. 1977. Correcting working postures in industry: a practical method for analysis. Applied Ergonomics 8, 4: 199--201.Google ScholarGoogle ScholarCross RefCross Ref
  27. Waldemar Karwowski. 2006. The Discipline of Ergonomics and Human Factors. In G. Salvendy, ed., Handbook of Human Factors & Ergonomics. John Wiley, New York, 1--25.Google ScholarGoogle Scholar
  28. I. Kuorinka, B. Jonsson, A. Kilbom, et al. 1987. Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Applied Ergonomics 18, 3: 233--237.Google ScholarGoogle ScholarCross RefCross Ref
  29. Luis Leite, Feup Esmad, Verónica Orvalho, and I T Fcup. 2017. Mani-Pull-Action: Hand-based Digital Puppetry. Proceedings of the ACM on Human-Computer Interaction - EICS, ACM, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Dan Lämkull, Lars Hanson, and Roland Örtengren. 2007. The influence of virtual human model appearance on visual ergonomics posture evaluation. Applied Ergonomics 38, 6: 713--722.Google ScholarGoogle ScholarCross RefCross Ref
  31. Liang Ma, Damien Chablat, Fouad Bennis, and Wei Zhang. 2009. A new simple dynamic muscle fatigue model and its validation. International Journal of Industrial Ergonomics 39, 1: 211--220.Google ScholarGoogle ScholarCross RefCross Ref
  32. Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, and François Guillaume. 2010. A new muscle fatigue and recovery model and its ergonomics application in human simulation. Virtual and Physical Prototyping 5, 3: 123--137.Google ScholarGoogle ScholarCross RefCross Ref
  33. Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, Bo Hu, and Franqois Guillaume. 2011. Fatigue evaluation in maintenance and assembly operations by digital human simulation in virtual environment. Virtual Reality 15, 1: 55--68.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. I. Scott MacKenzie. 1995. Input Devices and Interaction Techniques for Advanced Computing. In W. Barfield and T.A. Furness, eds., Virtual environments and advanced interface design. Oxford University Press, Oxford, UK, 437--470. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Giovanni De Magistris, Alain Micaelli, Paul Evrard, et al. 2013. Dynamic control of DHM for ergonomic assessments. International Journal of Industrial Ergonomics 43, 2: 170--180.Google ScholarGoogle ScholarCross RefCross Ref
  36. Giovanni De Magistris, Alain Micaelli, Jonathan Savin, Clarisse Gaudez, and Jacques Marsot. 2015. Dynamic digital human models for ergonomic analysis based on humanoid robotics techniques. International Journal of the Digital Human 1, 1: 81--109.Google ScholarGoogle ScholarCross RefCross Ref
  37. N. J. Mansfield and J. M. Marshall. 2001. Symptoms of musculoskeletal disorders in stage rally drivers and co-drivers. British journal of sports medicine 35, 5: 314--320.Google ScholarGoogle Scholar
  38. L. M. Mazur, P. R. Mosaly, L. M. Hoyle, E. L. Jones, and L. B. Marks. 2013. Subjective and objective quantification of physician's workload and performance during radiation therapy planning tasks. Practical radiation oncology 3, 4: e171--e177.Google ScholarGoogle Scholar
  39. Lucas M. Mazur, Prithima R. Mosaly, Lesley M. Hoyle, Ellen L. Jones, Bhishamjit S. Chera, and Lawrence B. Marks. 2014. Relating physician's workload with errors during radiation therapy planning. Practical radiation oncology 4, 2: 71--75.Google ScholarGoogle Scholar
  40. Lynn McAtamney and E. Nigel Corlett. 1993. RULA: A survey method for the investigation of work-related upper limb disorders. Applied Ergonomics 24, 2: 91--99.Google ScholarGoogle ScholarCross RefCross Ref
  41. Ville Mäkelä, Tomi Heimonen, Matti Luhtala, and Markku Turunen. 2014. Information wall: evaluation of a gesture-controlled public display. Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia, 228--231. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Jakob Nielsen. 2012. Usability 101: Introduction to usability. 1--13. Retrieved August 20, 2016 from http://www.nngroup.com/articles/usability-101-introduction-to-usability/.Google ScholarGoogle Scholar
  43. Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2003. A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction. In Proceedings of the 5th International Gesture Workshop, 1--12.Google ScholarGoogle Scholar
  44. Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Gesture-Based Communication in Human-Computer Interaction: 409--420.Google ScholarGoogle Scholar
  45. Donald A. Norman. 2010. Natural user interfaces are not natural. Interactions 17, 6--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Donald A. Norman and Jakob Nielsen. 2010. Gestural interfaces: A step backward in usability. Interactions 17, 46--49. Retrieved from http://dl.acm.org/ft_gateway.cfm?id=1836228&type=html. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Jorge Perez and W. Patrick Neumann. 2015. Ergonomicsts' and engineers' views on the utility of virtual human factors tools. Human Factors and Ergonomics in Manufacturing & Service Industries 25, 3: 279--293. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Charles Pontonnier, Georges Dumont, Asfhin Samani, Pascal Madeleine, and Marwan Badawi. 2013. Designing and evaluating a workstation in real and virtual environment: toward virtual reality based ergonomic design sessions. Journal on Multimodal User Interfaces: 1--10.Google ScholarGoogle Scholar
  49. Roland Örtengren, Dan Lämkull, and Lars Hanson. 2009. A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles. International Journal of Industrial Ergonomics 39, 2: 428--441.Google ScholarGoogle ScholarCross RefCross Ref
  50. Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined motion gestures for mobile interaction. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 197--206. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. J Sanjog, Sougata Karmakar, Thaneswer Patel, and Anirban Chowdhury. 2015. Towards virtual ergonomics: aviation and aerospace. Aircraft Engineering and Aerospace Technology 87, 3: 266--273.Google ScholarGoogle ScholarCross RefCross Ref
  52. Siemens. Jack and Process Simulate Human. Retrieved September 10, 2017 from https://www.plm.automation.siemens.com/en/products/tecnomatix/manufacturing-simulation/human-ergonomics/jack.shtml.Google ScholarGoogle Scholar
  53. Minseok Son, Haeseok Jung, Hyunkyung Yang, and Woojin Park. 2015. Evaluating physical discomfort associated with prolonged , repetitive use of gesture?: a comparison of subjective rating protocols. In Proceedings 19th Triennial Congress of the IEA, 9--11.Google ScholarGoogle Scholar
  54. R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human Computer Studies 61, 6: 751--789. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Helman I. Stern, Juan Wachs, and Yael Edan. 2006. Human Factors for Design of Hand Gesture Human - Machine Interaction. In Proceedings of the IEEE International Conference on Systems Man and Cybernetics, 4052--4056.Google ScholarGoogle ScholarCross RefCross Ref
  56. Anders Sundin and Roland Örtengren. 2006. Digital human modeling for CAE applications. In G. Salvendy, ed., Handbook of Human Factors and Ergonomics. John Wiley & Sons, New Jersey, 1053--1078.Google ScholarGoogle Scholar
  57. Jochen Triesch and Christoph Von Der Malsburg. 1998. A gesture interface for human-robot-interaction. Proceedings of third IEEE International Conference on Automatic Face and Gesture Recognition, 546--551. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Christian Vogt, Christian Mergl, and Heiner Bubb. 2005. Interior layout design of passenger vehicles with RAMSIS. Human Factors and Ergonomics In Manufacturing 15, 2: 197--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Kaisa Väänänen-Vainio-Mattila, Thomas Olsson, and Jari Laaksonen. 2012. An exploratory study of user-generated spatial gestures with social mobile devices. Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM '12, ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Kaisa Väänänen and Klaus Böhm. 1993. Gesture driven interaction as a human factor in virtual environments-An approach with neural networks. In Virtual reality systems. Academic Press, Ltd., London, UK, 93--106.Google ScholarGoogle Scholar
  61. Juan Pablo Wachs, Mathias Kölsch, Helman Stern, and Yael Edan. 2011. Vision-based Hand-gesture Applications. Commun. ACM 54, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Stefan Waldherr, Roseli Romero, and Sebastian Thrun. 2000. A Gesture Based Interface for Human-Robot Interaction. Autonomous Robots 9, 2: 151--173. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. SIGCHI Conference on Human Factors in Computing Systems (CHI'13), 841--850. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. G. Gary Wang. 2002. Definition and Review of Virtual Prototyping. Journal of Computing and Information Science in Engineering 2, 3: 232--236.Google ScholarGoogle ScholarCross RefCross Ref
  65. Thomas R. Waters, Vern Putz-Anderson, Arun Garg, and Lawrence J. Fine. 1993. Revised NIOSH equation for the design and evaluation of manual lifting tasks. Ergonomics 36, 7: 749--776.Google ScholarGoogle ScholarCross RefCross Ref
  66. Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the international conference on Human factors in computing systems (CHI'09), 1083--1092. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Tinghao Wu, Renran Tian, and Vincent G. Duffy. 2012. Performing Ergonomics Analyses through Virtual Interactive Design: Validity and Reliability Assessment. Human Factors and Ergonomics in Manufacturing & Service Industries 22, 3: 256--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Denny Yu, A. M. Abdelrahman, E. H. Buckarma, et al. 2015. Mental and physical workloads in a competitive laparoscopic skills training environment: a pilot study. Proceedings of the human factors and ergonomics society annual meeting, SAGE Publications, 508--512.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Digital Human Models in Human Factors and Ergonomics Evaluation of Gesture Interfaces

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Human-Computer Interaction
          Proceedings of the ACM on Human-Computer Interaction  Volume 2, Issue EICS
          June 2018
          293 pages
          EISSN:2573-0142
          DOI:10.1145/3233739
          Issue’s Table of Contents

          Copyright © 2018 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 19 June 2018
          Published in pacmhci Volume 2, Issue EICS

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader