Abstract
Gesture-based interfaces are becoming a widely used interaction modality in many industrial applications. Therefore, it is important to guarantee usable and ergonomic interfaces for workers. The purpose of this study was to investigate whether the use of digital human models (DHMs) by human factors/ergonomics (HFE) experts can complement the user evaluation of gesture interface prototypes. Two case studies were conducted, in which gesture-based systems for remote robot control were evaluated. The results indicate that the use of DHMs supports the findings from self-reported HFE evaluations. However, digital human modeling still has some limitations. For example, in this study, it was not possible to evaluate small muscle groups (e.g. fingers). We argue that adaptation of the DHMs could be a rapid and simple alternative for supporting the HFE design of gestures.
- Iina Aaltonen, Susanna Aromaa, Kaj Helin, and Ali Muhammad. 2017. Multimodality Evaluation Metrics for Human-Robot Interaction Needed?: A Case Study in Immersive Telerobotics. Proceedings of the 8th International Conference on Applied Human Factors and Ergonomics (AHFE 2017), 335--347.Google Scholar
- Norman Badler. 1997. Virtual humans for animation, ergonomics, and simulation. Proceedings IEEE Nonrigid and Articulated Motion Workshop: 28--36. Google ScholarDigital Library
- Norman I. Badler, Cary B. Phillips, and Bonnie L. Webber. 1993. Simulating Humans: Computer Graphics, Animation, and Control. . Google ScholarDigital Library
- Thomas Baudel and Michel Beaudouin-Lafon. 1993. Remote control of objects using free-hand gestures. Communications of the ACM 36, 7: 28--35. Google ScholarDigital Library
- Gunnar A. Borg. 1982. Psychophysical bases of perceived exertion. Med sci sports exerc 14, 5: 377--381.Google Scholar
- Marcio C. Cabral, Carlos H. Morimoto, and Marcelo K. Zuffo. 2005. On the usability of gesture interfaces in virtual reality environments. Proceedings of the Latin American conference on Human-computer interaction (CLIHC '05), 100--108. Google ScholarDigital Library
- Db Chaffin. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484. Google ScholarDigital Library
- Shao-Wen Chang and Mao-Jiun J. Wang. 2007. Human motion simulation for vehicle and workplace design. Human Factors and Ergonomics in Manufacturing 17, 5: 475--484. Google ScholarDigital Library
- Ken Tin-kai Chen. 2009. An Investigation Into Alternative Human-Computer Interaction in Relation To Ergonomics for Gesture Interface Design. Dissertation.Google Scholar
- Ngip Khean Chuan, Ashok Sivaji, and Wan Fatimah Wan Ahmad. 2014. Proposed Usability Heuristics for Testing Gestural Interaction. In Proceedings of the International Conference on Artificial Intelligence and Applications in Engineering and Technology, 233--238. Google ScholarDigital Library
- Herbert A. Colle and Gary B. Reid. 2005. Estimating a Mental Workload Redline in a Simulated Air-to-Ground Combat Mission. The International Journal of Aviation Psychology 15, 4: 303--319.Google ScholarCross Ref
- G C David. 2005. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occupational medicine (Oxford, England) 55, 3: 190--199.Google Scholar
- William Delamare, Céline Coutrix, and Laurence Nigay. 2015. Designing guiding systems for gesture-based interaction. Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS '15, ACM, 44--53. Google ScholarDigital Library
- H.O. Demirel and V.G. Duffy. 2007. Application of digital human modeling in industry. Digital Human Modeling: 824--832. Google ScholarDigital Library
- European Agency for Safety and Health at Work. 2007. Work-related musculoskeletal disorders (MSDs): an introduction.Google Scholar
- European Commission. 2014. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions on a EU Strategic Framework on Health and Safety at Work 2014--2020. 15. Retrieved March 24, 2016 from http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:No+Title#0.Google Scholar
- Scott S. Fisher, Michael McGreevy, Jeffrey Humphries, and Warren Robinett. 1987. Virtual environment display system. In Proceedings of the 1986 workshop on Interactive 3D graphics, 77--87. Google ScholarDigital Library
- Paul M. Fitts. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Biology 47, 6: 381--391.Google Scholar
- Lars Fritzsche. 2010. Ergonomics risk assessment with digital human models in car assembly: simulation versus real life. Human Factors and Ergonomics in Manufacturing & Service Industries 20, 4: 287--299. Google ScholarDigital Library
- Lars Hanson, Mikael Blomé, Tania Dukic, and Dan Högberg. 2006. Guide and documentation system to support digital human modeling applications. International Journal of Industrial Ergonomics 36, 1: 17--24.Google ScholarCross Ref
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52: 139--183.Google Scholar
- Sue Hignett and Lynn Mcatamney. 2000. Rapid entire body assessment (REBA). Applied Ergonomics 31: 201--205.Google ScholarCross Ref
- Eve Hoggan, Miguel Nacenta, Per Ola Kristensson, John Williamson, Antti Oulasvirta, and Anu Lehtiö. 2013. Multi-Touch Pinch Gestures: Performance and Ergonomics. In Proceedings of the ACM international conference on Interactive tabletops and surfaces, 219--222. Google ScholarDigital Library
- Eve Hoggan, John Williamson, Antti Oulasvirta, Miguel Nacenta, Per Ola Kristensson, and Anu Lehtiö. 2013. Multi-Touch Rotation Gestures: Performance and Ergonomics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3047--3050. Google ScholarDigital Library
- IEA. 2000. Definition and domains of ergonomics. Retrieved January 15, 2016 from http://www.iea.cc/whats/.Google Scholar
- Osmo Karhu, Pekka Kansi, and Ilkka Kuorinka. 1977. Correcting working postures in industry: a practical method for analysis. Applied Ergonomics 8, 4: 199--201.Google ScholarCross Ref
- Waldemar Karwowski. 2006. The Discipline of Ergonomics and Human Factors. In G. Salvendy, ed., Handbook of Human Factors & Ergonomics. John Wiley, New York, 1--25.Google Scholar
- I. Kuorinka, B. Jonsson, A. Kilbom, et al. 1987. Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Applied Ergonomics 18, 3: 233--237.Google ScholarCross Ref
- Luis Leite, Feup Esmad, Verónica Orvalho, and I T Fcup. 2017. Mani-Pull-Action: Hand-based Digital Puppetry. Proceedings of the ACM on Human-Computer Interaction - EICS, ACM, 1--16. Google ScholarDigital Library
- Dan Lämkull, Lars Hanson, and Roland Örtengren. 2007. The influence of virtual human model appearance on visual ergonomics posture evaluation. Applied Ergonomics 38, 6: 713--722.Google ScholarCross Ref
- Liang Ma, Damien Chablat, Fouad Bennis, and Wei Zhang. 2009. A new simple dynamic muscle fatigue model and its validation. International Journal of Industrial Ergonomics 39, 1: 211--220.Google ScholarCross Ref
- Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, and François Guillaume. 2010. A new muscle fatigue and recovery model and its ergonomics application in human simulation. Virtual and Physical Prototyping 5, 3: 123--137.Google ScholarCross Ref
- Liang Ma, Damien Chablat, Fouad Bennis, Wei Zhang, Bo Hu, and Franqois Guillaume. 2011. Fatigue evaluation in maintenance and assembly operations by digital human simulation in virtual environment. Virtual Reality 15, 1: 55--68.Google ScholarDigital Library
- I. Scott MacKenzie. 1995. Input Devices and Interaction Techniques for Advanced Computing. In W. Barfield and T.A. Furness, eds., Virtual environments and advanced interface design. Oxford University Press, Oxford, UK, 437--470. Google ScholarDigital Library
- Giovanni De Magistris, Alain Micaelli, Paul Evrard, et al. 2013. Dynamic control of DHM for ergonomic assessments. International Journal of Industrial Ergonomics 43, 2: 170--180.Google ScholarCross Ref
- Giovanni De Magistris, Alain Micaelli, Jonathan Savin, Clarisse Gaudez, and Jacques Marsot. 2015. Dynamic digital human models for ergonomic analysis based on humanoid robotics techniques. International Journal of the Digital Human 1, 1: 81--109.Google ScholarCross Ref
- N. J. Mansfield and J. M. Marshall. 2001. Symptoms of musculoskeletal disorders in stage rally drivers and co-drivers. British journal of sports medicine 35, 5: 314--320.Google Scholar
- L. M. Mazur, P. R. Mosaly, L. M. Hoyle, E. L. Jones, and L. B. Marks. 2013. Subjective and objective quantification of physician's workload and performance during radiation therapy planning tasks. Practical radiation oncology 3, 4: e171--e177.Google Scholar
- Lucas M. Mazur, Prithima R. Mosaly, Lesley M. Hoyle, Ellen L. Jones, Bhishamjit S. Chera, and Lawrence B. Marks. 2014. Relating physician's workload with errors during radiation therapy planning. Practical radiation oncology 4, 2: 71--75.Google Scholar
- Lynn McAtamney and E. Nigel Corlett. 1993. RULA: A survey method for the investigation of work-related upper limb disorders. Applied Ergonomics 24, 2: 91--99.Google ScholarCross Ref
- Ville Mäkelä, Tomi Heimonen, Matti Luhtala, and Markku Turunen. 2014. Information wall: evaluation of a gesture-controlled public display. Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia, 228--231. Google ScholarDigital Library
- Jakob Nielsen. 2012. Usability 101: Introduction to usability. 1--13. Retrieved August 20, 2016 from http://www.nngroup.com/articles/usability-101-introduction-to-usability/.Google Scholar
- Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2003. A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction. In Proceedings of the 5th International Gesture Workshop, 1--12.Google Scholar
- Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Gesture-Based Communication in Human-Computer Interaction: 409--420.Google Scholar
- Donald A. Norman. 2010. Natural user interfaces are not natural. Interactions 17, 6--10. Google ScholarDigital Library
- Donald A. Norman and Jakob Nielsen. 2010. Gestural interfaces: A step backward in usability. Interactions 17, 46--49. Retrieved from http://dl.acm.org/ft_gateway.cfm?id=1836228&type=html. Google ScholarDigital Library
- Jorge Perez and W. Patrick Neumann. 2015. Ergonomicsts' and engineers' views on the utility of virtual human factors tools. Human Factors and Ergonomics in Manufacturing & Service Industries 25, 3: 279--293. Google ScholarDigital Library
- Charles Pontonnier, Georges Dumont, Asfhin Samani, Pascal Madeleine, and Marwan Badawi. 2013. Designing and evaluating a workstation in real and virtual environment: toward virtual reality based ergonomic design sessions. Journal on Multimodal User Interfaces: 1--10.Google Scholar
- Roland Örtengren, Dan Lämkull, and Lars Hanson. 2009. A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles. International Journal of Industrial Ergonomics 39, 2: 428--441.Google ScholarCross Ref
- Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined motion gestures for mobile interaction. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 197--206. Google ScholarDigital Library
- J Sanjog, Sougata Karmakar, Thaneswer Patel, and Anirban Chowdhury. 2015. Towards virtual ergonomics: aviation and aerospace. Aircraft Engineering and Aerospace Technology 87, 3: 266--273.Google ScholarCross Ref
- Siemens. Jack and Process Simulate Human. Retrieved September 10, 2017 from https://www.plm.automation.siemens.com/en/products/tecnomatix/manufacturing-simulation/human-ergonomics/jack.shtml.Google Scholar
- Minseok Son, Haeseok Jung, Hyunkyung Yang, and Woojin Park. 2015. Evaluating physical discomfort associated with prolonged , repetitive use of gesture?: a comparison of subjective rating protocols. In Proceedings 19th Triennial Congress of the IEA, 9--11.Google Scholar
- R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human Computer Studies 61, 6: 751--789. Google ScholarDigital Library
- Helman I. Stern, Juan Wachs, and Yael Edan. 2006. Human Factors for Design of Hand Gesture Human - Machine Interaction. In Proceedings of the IEEE International Conference on Systems Man and Cybernetics, 4052--4056.Google ScholarCross Ref
- Anders Sundin and Roland Örtengren. 2006. Digital human modeling for CAE applications. In G. Salvendy, ed., Handbook of Human Factors and Ergonomics. John Wiley & Sons, New Jersey, 1053--1078.Google Scholar
- Jochen Triesch and Christoph Von Der Malsburg. 1998. A gesture interface for human-robot-interaction. Proceedings of third IEEE International Conference on Automatic Face and Gesture Recognition, 546--551. Google ScholarDigital Library
- Christian Vogt, Christian Mergl, and Heiner Bubb. 2005. Interior layout design of passenger vehicles with RAMSIS. Human Factors and Ergonomics In Manufacturing 15, 2: 197--212. Google ScholarDigital Library
- Kaisa Väänänen-Vainio-Mattila, Thomas Olsson, and Jari Laaksonen. 2012. An exploratory study of user-generated spatial gestures with social mobile devices. Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM '12, ACM. Google ScholarDigital Library
- Kaisa Väänänen and Klaus Böhm. 1993. Gesture driven interaction as a human factor in virtual environments-An approach with neural networks. In Virtual reality systems. Academic Press, Ltd., London, UK, 93--106.Google Scholar
- Juan Pablo Wachs, Mathias Kölsch, Helman Stern, and Yael Edan. 2011. Vision-based Hand-gesture Applications. Commun. ACM 54, 2. Google ScholarDigital Library
- Stefan Waldherr, Roseli Romero, and Sebastian Thrun. 2000. A Gesture Based Interface for Human-Robot Interaction. Autonomous Robots 9, 2: 151--173. Google ScholarDigital Library
- Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. SIGCHI Conference on Human Factors in Computing Systems (CHI'13), 841--850. Google ScholarDigital Library
- G. Gary Wang. 2002. Definition and Review of Virtual Prototyping. Journal of Computing and Information Science in Engineering 2, 3: 232--236.Google ScholarCross Ref
- Thomas R. Waters, Vern Putz-Anderson, Arun Garg, and Lawrence J. Fine. 1993. Revised NIOSH equation for the design and evaluation of manual lifting tasks. Ergonomics 36, 7: 749--776.Google ScholarCross Ref
- Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the international conference on Human factors in computing systems (CHI'09), 1083--1092. Google ScholarDigital Library
- Tinghao Wu, Renran Tian, and Vincent G. Duffy. 2012. Performing Ergonomics Analyses through Virtual Interactive Design: Validity and Reliability Assessment. Human Factors and Ergonomics in Manufacturing & Service Industries 22, 3: 256--268. Google ScholarDigital Library
- Denny Yu, A. M. Abdelrahman, E. H. Buckarma, et al. 2015. Mental and physical workloads in a competitive laparoscopic skills training environment: a pilot study. Proceedings of the human factors and ergonomics society annual meeting, SAGE Publications, 508--512.Google ScholarCross Ref
Index Terms
Digital Human Models in Human Factors and Ergonomics Evaluation of Gesture Interfaces
Recommendations
The Study on the Ergonomics of Hand Tractor Based on Digital Human Model
ICMTMA '14: Proceedings of the 2014 Sixth International Conference on Measuring Technology and Mechatronics AutomationAccording to the hand tractor only pay attention to the functional design, do not take the ergonomics design into account, lead to accumulating disease to the farmer. The ergonomics design in hand tractor was discussed in this paper. Digital human model ...
Human-virtual human interaction by upper body gesture understanding
VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, a novel human-virtual human interaction system is proposed. This system supports a real human to communicate with a virtual human using natural body language. Meanwhile, the virtual human is capable of understanding the meaning of human ...
Parametric human body shape modeling framework for human-centered product design
The objective of this study is the development of a novel parametric human body shape modeling framework for integration into various product design applications. Our modeling framework is comprised of three phases of database construction, statistical ...
Comments