Lian Loke
Skip Abstract Section
Abstract
There is growing interest in designing for movement-based interactions with technology, now that various sensing technologies are available enabling a range of movement possibilities from gestural to whole-body interactions. We present a design methodology of Moving and Making Strange, an approach to movement-based interaction design that recognizes the central role of the body and movement in lived cognition. The methodology was developed through a series of empirical projects, each focusing on different conceptions of movement available within motion-sensing interactive, immersive spaces. The methodology offers designers a set of principles, perspectives, methods, and tools for exploring and testing movement-related design concepts. It is innovative for the inclusion of the perspective of the mover, together with the traditional perspectives of the observer and the machine. Making strange is put forward as an important tactic for rethinking how to approach the design of movement-based interaction.
- Bell, G., Blythe, M., and Sengers, P. 2005. Making by making strange: Defamiliarization and the design of domestic technologies. ACM Trans. Comput.-Hum. Interact. 12, 2, 149--173. Google Scholar
Digital Library
- Benford, S., Schnädelbach, H., Koleva, B., Anastasi, R., Greenhalgh, C., Rodden, T., Green, J., Ghali, A., Pridmore, T., Gaver, B., Boucher, A., Walker, B., Pennington, S., Schmidt, A., Gellersen, H., and Steed, A. 2005. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Trans. Comput.-Hum. Interact. 12, 1, 3--30. Google ScholarDigital Library
- Blom, L. A. and Chaplin, L. T. 1988. The Moment of Movement: Dance Improvisation. University of Pittsburgh Press, Pittsburgh, PA.Google Scholar
- Bongers, B. and Veer, G. C. 2007. Towards a multimodal interaction space: Categorisation and applications. Pers. Ubiquit. Comput. 11, 8, 609--619. Google ScholarDigital Library
- Buur, J., Jensen, M. V., and Djajadiningrat, T. 2004. Hands-Only scenarios and video action walls: Novel methods for tangible user interaction design. In Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. ACM Press, New York, 185--192. Google ScholarDigital Library
- Danto, A. C. 1981. The Transfiguration of the Commonplace: A Philosophy of Art. Harvard University Press, Cambridge, MA.Google Scholar
- De Bono, E. 1994. de Bono's Thinking Course. BBC Books, London.Google Scholar
- Djajadiningrat, J. P., Gaver, W. W., and Frens, J. W. 2000. Interaction relabelling and extreme characters: Methods for exploring aesthetic interactions. In Proceedings of the 3rd Conference on Designing Interactive Systems (DIS'00). ACM Press, New York, 66--71. Google ScholarDigital Library
- Djajadiningrat, J. P., Matthews, B., and Stienstra, M. 2007. Easy doesn't do it: Skill and expression in tangible aesthetics. J. Pers. Ubiquit. Comput. 11, 8, 657--676. Google ScholarDigital Library
- Donovan, J. and Brereton, M. 2004. Meaning in movement: A gestural design game. In Proceedings of the 8th Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices. vol 2. 163--166.Google Scholar
- Dourish, P. 2001. Where the Action Is: The Foundations of Embodied Interactions. The MIT Press, Cambridge, MA. Google ScholarDigital Library
- Edwards, B. 1979. Drawing on the Right Side of the Brain. Fontana, London.Google Scholar
- Eriksson, E., Hansen, T. R., and Lykke-Olesen, A. 2007. Movement-Based interaction in camera spaces: A conceptual framework. Pers. Ubiquit. Comput. 11, 8, 621--632. Google ScholarDigital Library
- Fogtmann, M. H., Fritsch, J., and Kortbek, K. J. 2008. Kinesthetic interaction: Revealing the bodily potential in interaction design. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI'08). ACM Press, New York, 89--96. Google ScholarDigital Library
- Forlizzi, J., Zimmerman, J., and Evenson, S. 2008. Crafting a place for interaction design research in hci. Des. Issues 24, 3.Google ScholarCross Ref
- Garfinkel, H. 1967. Studies in Ethnomethodology. Prentice-Hall, Englewood Cliffs, NJ.Google Scholar
- Gaver, W. W., Dunne, A., and Pacenti, E. 1999. Cultural probes. Interact. 6, 1, 21--29. Google ScholarDigital Library
- Geertz, C. 1973. The Interpretation of Cultures. Basic Books.Google Scholar
- Hornecker, E. and Buur, J. 2006. Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'06). ACM Press, New York, 437--446. Google ScholarDigital Library
- Hummels, C., Overbeeke, C. J., and Klooster, S. 2007. Move to get moved: A search for methods, tools and knowledge to design for expressive and rich movement-based interaction. J. Pers. Ubiquit. Comput. 11, 8, 677--690. Google ScholarDigital Library
- Hutchinson, A. 1977. Labanotation or Kinetography Laban: The System of Analyzing and Recording Movement. Theatre Arts Books, New York.Google Scholar
- Jensen, M. V., Buur, J., and Djajadiningrat, T. 2005. Designing the user actions in tangible interaction. In Proceedings 4th Decennial Conference on Critical Computing (CC'05). ACM Press, New York, 9--18. Google ScholarDigital Library
- Jensen, M. V. 2007. A physical approach to tangible interaction design. In Proceedings 1st International Conference on Tangible and Embedded Interaction (TEI'07). ACM Press, New York, 241--244. Google ScholarDigital Library
- Jensen, M. V., and Stienstra, M. 2007. Making sense: Interactive sculptures as tangible design material. In Proceedings Conference on Designing Pleasurable Products and Interfaces (DPPI'07). ACM Press, New York, 255--269. Google ScholarDigital Library
- Klooster, S. and Overbeeke, C. J. 2005. Designing products as an integral part of choreography of interaction: The product's form as an integral part of movement. In Proceedings 1st International Workshop on Design and Semantics of Form and Movement (DeSForM'05). 23--35.Google Scholar
- Laban, R. 1971. The Mastery of Movement. Play Inc, Boston.Google Scholar
- Larssen, A. T., Robertson, T., and Edwards, J. 2007a. The feel dimension of technology interaction: Exploring tangibles through movement and touch. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI'07). ACM Press, New York. Google ScholarDigital Library
- Larssen, A. T., Robertson, T., and Edwards, J. 2007b. Experiential bodily knowing as a design (sens)-ability in interaction design. In Proceedings 3rd European Conference on Design and Semantics of Form and Movement (DeSForM'07).Google Scholar
- Larssen, A. T., Robertson, T., Loke, L., and Edwards, J. 2007c. Introduction to the special issue on movement-based interaction. Pers. Ubiquit. Comput. 11, 8, 607--608. Google ScholarDigital Library
- Levisohn, A. M. 2011. Designing for movement experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM Press, New York, 1029--1032. Google ScholarDigital Library
- Levisohn, A. and Schiphorst, T. 2011. Embodied engagement: Supporting movement awareness in ubiquitous computing systems. Ubiquit. Learn. Int. J. 3, 4, 97--112.Google ScholarCross Ref
- Loke, L., Larssen, A. T., and Robertson, T. 2005. Labanotation for design of movement-based interaction. In Proceedings of the Conference on Interactive Entertainment. 23--25. Google ScholarDigital Library
- Loke, L., Larssen, A. T., Robertson, T., and Edwards, J. 2007. Understanding movement for interaction design: Frameworks and approaches. Pers. Ubiquit. Comput. 11, 8, 691--701. Google ScholarDigital Library
- Loke, L. and Robertson, T. 2009. Design representations of moving bodies in interactive, immersive spaces. Int. J. Hum.-Comput. Stud. 67, 4, 394--410. Google ScholarDigital Library
- Loke, L. and Robertson, T. 2010. Studies of dancers: Moving from experience to interaction design. Int. J. Des. 4, 2, 39--54.Google Scholar
- Loke, L. and Robertson, T. 2011. The lived body in design: Mapping the terrain. In Proceedings of the 23rd Australian Computer-Human Interaction Conference (OzCHI'11). ACM Press, New York, 181--184. Google ScholarDigital Library
- Marcus, G. E. and Fischer, M. M. 1986. Anthropology as Cultural Critique: An Experimental Moment in the Human Sciences, 2nd ed. The University of Chicago Press, Chicago.Google Scholar
- Merleau-Ponty, M. 1962. Phenomenology of Perception. Routledge, London.Google Scholar
- Moen, J. 2007. From hand-held to body-worn: Embodied experiences of the design and use of a wearable movement-based interaction concept. In Proceedings 1st International Conference on Tangible and Embedded Interaction (TEI'07). ACM Press, New York, 251--258. Google ScholarDigital Library
- Robertson, T. 1997. Cooperative work and lived cognition: A taxonomy of embodied actions. In Proceedings of the 5th European Conference on Computer-Supported Cooperative Work. Kluwer Academic Publishers, 205--220. Google ScholarDigital Library
- Robertson, T., Mansfield, T., and Loke, L. 2006. Designing an immersive environment for public use. In Proceedings of the Participatory Design Conference (PDC'06). Google ScholarDigital Library
- Robertson, T. and Loke, L. 2009. Designing situations. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI'09). ACM Press, New York, 1--8. Google ScholarDigital Library
- Rogers, Y. and Muller, H. 2006. A framework for designing sensor-based interactions to promote exploration and reflection in play. Int. J. Hum.-Comput. Stud. 64, 1, 1--14. Google ScholarDigital Library
- Ross, P. R. and Wensveen, S. A. G. 2010. Designing aesthetics of behavior in interaction: Using aesthetic experience as a mechanism for design. Int. J. Des. 4, 2, 3--13.Google Scholar
- Schiphorst, T. and Andersen, K. 2004. Between bodies: Using experience modeling to create gestural protocols for physiological data transfer. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'04) Fringe Papers. ACM Press, New York.Google Scholar
- Schiphorst, T. 2007. Really, really small: The palpability of the invisible. In Proceedings 6th ACM SIGCHI Conference on Creativity and Cognition (C&C'07). ACM Press, New York, 7--16. Google ScholarDigital Library
- Schiphorst, T. 2011. Self-Evidence: Applying somatic connoisseurship to experience design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM Press, New York, 145--160. Google ScholarDigital Library
- Sheets-Johnstone, M. 1999. The Primacy of Movement. John Benjamins Publishing.Google Scholar
- Shklovsky, V. 2000. Art as technique. In Modern Criticism and Theory: A Reader. Longman, Harlow.Google Scholar
- Star, S. L. 1990. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. Distrib. Artif. Intell. 2, 37--54. Google ScholarDigital Library
- Suchman, L. A. 1987. Plans and Situated Actions: The Problem of Human Machine Communication. Cambridge University Press. Google ScholarDigital Library
- Sundström, P., Taylor, A., Grufberg, K., Wirström, N., Belenguer, J. S., and Lundén, M. 2011. Inspirational bits: Towards a shared understanding of the digital material. In Proceedings of the Annual Conference on Human Factors in Computing Systems (CHI'11). ACM Press, New York, 1561--1570. Google ScholarDigital Library
- Svanæs, D. 2000. Understanding interactivity: Steps to a phenomenology of human-computer interaction. Ph.D. thesis, NTNU, Trondheim, Norway.Google Scholar
- Tholander, J. and Johansson, C. 2010. Design qualities for whole body interaction: Learning from golf, skateboarding and bodybugging. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI'10). ACM Press, New York, 493--502. Google ScholarDigital Library
- Wensveen, S. A. G., Djajadiningrat, J. P., and Overbeeke, C. J. 2004. Interaction frogger: A design framework to couple action and function through feedback and feedforward. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS'04). ACM Press, New York, 177--184. Google ScholarDigital Library
Index Terms
- Moving and making strange: An embodied approach to movement-based interaction design
Recommendations
Inventing and devising movement in the design of movement-based interactive systems
OZCHI '08: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and HabitatThis paper reports on a study that explored ways of inventing and devising movement for use in the design of movement-based interaction with video-based, motion-sensing technologies. Methods that dancers, trained in movement improvisation and ...
Tagging with Movement: Somatic Strategies for Image Classification
MOCO '14: Proceedings of the 2014 International Workshop on Movement and ComputingMovement researchers in HCI have begun to utilize theories from the field of Somatics to support their investigations into tangible, ubiquitous, and wearable computing systems. Despite recent advances in integrating movement theory within HCI, the ...
It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets
Distributed, Ambient and Pervasive InteractionsAbstractResearch on gestural control interfaces is getting more widespread for the purpose of creating natural interfaces. Two of these popular gesture types are freehand and on-skin touch gestures, because they eliminate the use of an intermediary ...
Comments