Diego Silang Maranan
Philippe Pasquier
ABSTRACT
While single-accelerometers are a common consumer embedded sensors, their use in representing movement data as an intelligent resource remains scarce. Accelerometers have been used in movement recognition systems, but rarely to assess expressive qualities of movement. We present a prototype of wearable system for the real-time detection and classification of movement quality using acceleration data. The system applies Laban Movement Analysis (LMA) to recognize Laban Effort qualities from acceleration input using a Machine Learning software that generates classifications in real time. Existing LMA-recognition systems rely on motion capture data and video data, and can only be deployed in controlled settings. Our single-accelerometer system is portable and can be used under a wide range of environmental conditions. We evaluate the performance of the system, present two applications using the system in the digital arts and discuss future directions.
Supplemental Material
- Amstutz, R., Amft, O., French, B., Smailagic, A., Siewiorek, D., and Troster, G. Performance Analysis of an HMM-Based Gesture Recognition Using a Wristwatch Device. Proceedings of the International Conference on Computational Science and Engineering. (CSE), IEEE (2009), 303--309. Google Scholar
Digital Library
- Barakova, E.I. and Lourens, T. Expressing and interpreting emotional movements in social games with robots. Proceedings of the Personal Ubiquitous Comput. 14, 5 (2010), 457--467. Google ScholarDigital Library
- Bartenieff, I. and Lewis, D. Body Movement: Coping with the Environment. Routledge, 1980.Google Scholar
- Bergson, H. Matter and Memory. Zone Books, New York, 1988.Google Scholar
- Bindiganavale, R.N. Building parameterized action representations from observation. Doctoral dissertation University of Pennsylvania Philadelphia, PA, USA, 2000. Google ScholarDigital Library
- Bott, J.N., Crowley, J.G., and LaViola,Jr., J.J. Exploring 3D gestural interfaces for music creation in video games. Proceedings of the 4th International Conference on Foundations of Digital Games, ACM (2009), 18--25. Google ScholarDigital Library
- Bouchard, D. and Badler, N. Semantic segmentation of motion capture using Laban Movement Analysis. Proceedings of the international conference o Intelligent Virtual Agents, Springer (2007), 37--44. Google ScholarDigital Library
- Chi, D., Costa, M., Zhao, L., and Badler, N. The EMOTE model for Effort-Shape. Proceedings of the conference on computer graphics and interactive techniques, ACM (2000), 173--182. Google ScholarDigital Library
- Djajadiningrat, T., Matthews, B., and Stienstra, M. Easy doesn't do it: skill and expression in tangible aesthetics. Personal and Ubiquitous Computing 11, 8 (2007), 657676. Google ScholarDigital Library
- Farella, E., O'Modhrain, S., Benini, L., and Riccó, B. Gesture Signature for Ambient Intelligence Applications: A Feasibility Study. In K.P. Fishkin, B. Schiele, P. Nixon and A. Quigley, eds., Pervasive Computing. Springer Berlin Heidelberg, 2006, 288--304. Google ScholarDigital Library
- Fdili Alaoui, S., Caramiaux, B., Serrano, M. and Bevilacqua, F., Dance Movement Quality as Interaction Modality. Proceedings of the International Conference on Designing Interactive Systems (DIS), ACM (2012) 761--769. Google ScholarDigital Library
- Hashim, W.N.W., Noor, N.L.M., and Adnan, W.A.W. The design of aesthetic interaction: towards a graceful interaction framework. Proceedings of the International Conference on Interaction Sciences: Information Technology, Culture and Human, ACM (2009), 69--75. Google ScholarDigital Library
- Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. GesText: accelerometer-based gestural text-entry systems. Proceedings of the International Conference on Human Factors in Computing Systems (SIGCHI), ACM (2010), 2173--2182. Google ScholarDigital Library
- Khoshhal, K., Aliakbarpour, H., Quintas, J., Drews, P., and Dias, J. Probabilistic LMA-based classification of human behaviour understanding using Power Spectrum technique. Proceedings of the 13th Conference on Information Fusion (FUSION), IEEE (2010), 1--7.Google ScholarCross Ref
- Laban, R. and Lawrence, F.C. Effort: Economy of Human Movement. Macdonald and Evans, Plymouth, 1974.Google Scholar
- Laban, R. Effort. Macdonald & Evans, London, 1947.Google Scholar
- Loke, L., Larssen, A.T., Robertson, T., and Edwards, J. Understanding movement for interaction design: frameworks and approaches. Personal and Ubiquitous Computing 11, (2007), 691--701. Google ScholarDigital Library
- Mentis, H., and Johansson, C. Seeing movement qualities. Proceedings of the International Conference on Human Factors in Computing Systems (SIGCHI), ACM (2013), 3375--3384. n Google ScholarDigital Library
- Moore, C.L. and Yamamoto, K. Beyond Words: Movement Observation and Analysis. Gordon & Breach Science Publishers, New York, U.S.A, 1988.Google Scholar
- Nakata, T., Mori, T., and Sato, T. Analysis of impression of robot bodily expression. Journal of Robotics and Mechatronics 14, 1 (2002), 27--36.Google ScholarCross Ref
- Pietrowicz, M., Garnett, G., McGrath, R., and Toenjes, J. Multimodal gestural interaction in performance. Proceedings of the International Conference on Human Factors in Computing Systems (SIGCHI), ACM (2010).Google Scholar
- Rett, J., Dias, J., and Ahuactzin, J.-M. Bayesian reasoning for Laban Movement Analysis used in humanmachine interaction. International Journal of Reasoning-based Intelligent Systems 2, 1 (2010), 13--35.Google ScholarCross Ref
- Roudaut, A., Baglioni, M., and Lecolinet, E. TimeTilt: Using Sensor-Based Gestures to Travel through Multiple Applications on a Mobile Device. Proceedings of INTERACT International Conference on HumanComputer Interaction, Springer-Verlag (2009), 830--834. Google ScholarDigital Library
- Santos, L., Prado, J.A., and Dias, J. Human Robot interaction studies on Laban human movement analysis and dynamic background segmentation. Proceedings of the IEEE/RSJ international conference on Intelligent robots and systems (2009), 4984--4989. Google ScholarDigital Library
- Schiphorst, T., Nack, F., KauwATjoe, M., et al. PillowTalk: can we afford intimacy? Proceedings of the 1st international conference on Tangible and embedded interaction, ACM (2007), 23--30. Google ScholarDigital Library
- Schiphorst, T. Self-evidence: applying somatic connoisseurship to experience design. Proceedings of the International Conference on Human Factors in Computing Systems (SIGCHI), ACM (2011), 145--160. Google ScholarDigital Library
- Scoditti, A., Blanch, R., and Coutaz, J. A novel taxonomy for gestural interaction techniques based on accelerometers. Proceedings of the 16th international conference on Intelligent user interfaces, ACM (2011), 63--72. Google ScholarDigital Library
- Sheets-Johnstone, M. The Primacy of Movement. John Benjamins Publishing Company, Amsterdam, 1999.Google ScholarCross Ref
- Swaminathan, D., Thornburg, H., Mumford, J., Rajko, S., James, J., Ingalls, T., Campana, E., Qian, G., Sampath, P., Peng, B., A dynamic Bayesian approach to computational Laban shape quality analysis. Advances in Human Computer Interaction, (2009), 1--17. Google ScholarDigital Library
- Widmer, G., Kubat, M., Learning in the presence of concept drift and hidden contexts, Machine Learning, 23, 1 (1996), 69--101. Google ScholarDigital Library
- Wilson, A. and Shafer, S. XWand: UI for intelligent spaces. Proceedings of the International Conference on Human Factors in Computing Systems (SIGCHI), ACM (2003), 545--552. Google ScholarDigital Library
- Zhao, L. and Badler, N. Acquiring and validating motion qualities from live limb gestures. Graphical Models 67, 1 (2005), 1--16. Google ScholarDigital Library
Index Terms
- Designing for movement: evaluating computational models using LMA effort qualities
Recommendations
Seeing, Sensing and Recognizing Laban Movement Qualities
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsHuman movement has historically been approached as a functional component of interaction within human computer interaction. Yet movement is not only functional, it is also highly expressive. In our research, we explore how movement expertise as ...
Labanotation for design of movement-based interaction
IE '05: Proceedings of the second Australasian conference on Interactive entertainmentThis paper reports findings from a study of Labanotation, an already established movement notation, as a design tool for movement-based interaction where movements of the human body are direct input to technology. Using Labanotation, we transcribed ...
Insight into goal-directed movement strategies
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe current paper proposes a novel method of analyzing goal-directed movements by dividing them into distinct movement intervals. We demonstrate how the description of the first and second most prominent movement intervals in terms of duration and ...
Comments